-- Logs begin at Wed 2022-05-18 21:32:20 UTC, end at Wed 2022-05-18 23:06:11 UTC. -- May 18 22:32:11.269696 dv-cinder-838009-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 22:32:11.278561 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 22:32:11 2022] *** May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: nodename: dv-cinder-838009-6-iscsi May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: machine: x86_64 May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: clock source: unix May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: pcre jit disabled May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: detected number of CPU cores: 4 May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: current working directory: / May 18 22:32:11.280516 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: detected binary path: /usr/bin/uwsgi-core May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: your processes number limit is 47680 May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: your memory page size is 4096 bytes May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: detected max file descriptor number: 2048 May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: lock engine: pthread robust mutexes May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: thunder lock: enabled May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 22:32:11.281238 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 22:32:11.325266 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: Python main interpreter initialized at 0x56472fd599c0 May 18 22:32:11.325266 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: python threads support enabled May 18 22:32:11.325266 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: your server socket listen backlog is limited to 100 connections May 18 22:32:11.325266 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: your mercy for graceful operations on workers is 90 seconds May 18 22:32:11.325594 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: mapped 403077 bytes (393 KB) for 2 cores May 18 22:32:11.325594 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: *** Operational MODE: preforking *** May 18 22:32:11.325862 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: *** uWSGI is running in multiple interpreter mode *** May 18 22:32:11.325862 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: spawned uWSGI master process (pid: 109890) May 18 22:32:11.326069 dv-cinder-838009-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 22:32:11.327426 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: spawned uWSGI worker 1 (pid: 109891, cores: 1) May 18 22:32:11.327559 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: spawned uWSGI worker 2 (pid: 109892, cores: 1) May 18 22:32:11.327633 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 22:32:12.537980 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 22:32:12.544080 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 22:32:13.270249 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:32:13.270249 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: from cryptography.utils import int_from_bytes May 18 22:32:13.270582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:32:13.270582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: from cryptography.utils import int_from_bytes May 18 22:32:13.271554 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:32:13.271554 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: from cryptography.utils import int_from_bytes May 18 22:32:13.271880 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:32:13.271880 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: from cryptography.utils import int_from_bytes May 18 22:32:15.862998 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 22:32:15.863675 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 22:32:15.863776 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 22:32:15.864102 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 22:32:15.864356 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 22:32:15.864737 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.865062 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.865380 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.865697 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.866041 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.866351 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.866667 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.866979 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.867304 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.867564 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.867874 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.867971 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 22:32:15.868333 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-6-iscsi {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.868416 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 22:32:15.868506 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.868733 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 22:32:15.868833 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.869083 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.869234 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 22:32:15.869344 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 22:32:15.869431 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.869683 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.869799 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.870010 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.870109 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.870319 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.870414 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.870677 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.870818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.871027 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.871323 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.871541 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.871657 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.871854 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.871971 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.872166 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.872288 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.872502 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.872603 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.872816 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.872912 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.873126 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.873214 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-6-iscsi {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.873444 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.873546 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.873749 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.873836 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.874081 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.874185 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.874389 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.874490 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.874693 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.874787 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-6-iscsi {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.875016 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.875159 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.875428 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.875525 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.875743 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.876157 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.876266 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.876465 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.876557 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.876774 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.876869 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.877088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.877193 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.877406 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.877501 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.877713 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.877805 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878039 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878142 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878367 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878462 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878676 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878779 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.878991 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.879088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.879290 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.879388 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.879599 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.879704 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-6-iscsi {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.879906 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880005 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880219 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880309 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880521 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880617 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880823 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.880988 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.881087 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.881303 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.881400 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.881614 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.881710 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.881937 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882072 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882298 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882395 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882544 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882640 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882791 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.882922 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.883106 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.883243 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.883421 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.883562 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.883726 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.883881 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884031 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884183 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884336 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884513 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884640 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884786 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.884941 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885107 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885243 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885412 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885546 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885848 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.885966 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.886189 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.886296 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.886504 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.886593 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.886823 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.886919 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.887129 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.887231 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.887446 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.887545 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.887704 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.887838 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888023 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888113 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888345 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888446 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888655 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888756 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.888962 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.889057 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.889271 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.889402 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.889581 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.889679 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.889905 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.890063 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.890216 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.890304 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.890520 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.890619 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.891352 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.891486 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.891678 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.891821 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.891981 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.892315 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.892412 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.892632 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.892719 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.892935 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893023 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893241 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893330 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893557 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893646 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893863 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.893964 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.894194 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.894301 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.894499 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.894587 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.894795 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.894897 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.895100 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.895195 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.895403 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.895491 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.895707 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.895809 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896012 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896108 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896316 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896405 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896618 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896717 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.896921 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897017 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897223 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897311 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897524 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897622 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897797 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.897884 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.898124 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.898234 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.898436 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.898527 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.898752 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.898840 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899055 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899359 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899454 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899668 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899759 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.899967 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900070 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900268 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900358 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900577 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900664 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900875 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.900964 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.901174 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.901263 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.901477 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.901607 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.901781 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.901870 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.902103 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.902193 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.902408 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.902497 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.902702 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.902788 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903006 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903096 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903318 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903413 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903623 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903719 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.903921 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904015 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904220 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904309 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904521 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904619 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904820 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.904909 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.905119 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.905208 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.905416 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.905520 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.905713 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.905802 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.906030 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.906122 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.906339 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.906441 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.907263 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.907456 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.907613 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.907921 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908011 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908225 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908323 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908542 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908633 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908853 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.908949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.909168 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.909260 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.909488 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.909577 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.909802 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.909907 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.910135 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.910228 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.910444 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.910532 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.910751 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.910855 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.911056 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.911145 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.911366 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.911457 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.911669 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.911767 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.911975 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.912073 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.912277 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.912367 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.912585 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.912682 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.912903 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.912992 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.913208 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.913303 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.913518 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.913608 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.913822 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.913918 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.914155 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.914246 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:32:15.914473 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.914570 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.914782 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.914870 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.915098 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.915188 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.915424 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.915522 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.915743 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.915831 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.916050 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.916162 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.916389 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.916479 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.916704 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.916791 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917021 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917111 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917342 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917431 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917652 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917741 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.917959 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.918103 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.918291 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.918391 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.918599 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.918697 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.918917 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919015 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919248 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919342 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919559 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919656 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919873 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.919971 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.920180 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.920275 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.920489 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.920579 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.920796 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.920893 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.921107 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.921196 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.921423 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.921510 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.921735 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.921831 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.922104 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.922195 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.922446 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.922709 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.922851 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923049 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923141 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923361 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923449 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923672 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923775 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.923982 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924071 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924283 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924371 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924586 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924685 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924887 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.924977 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.925193 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.925288 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.925496 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.925593 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.925811 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.925900 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.926161 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.926253 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.926468 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.926558 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.926778 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.926866 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.927085 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.927173 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.927391 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.927488 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.927697 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.927785 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928003 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928093 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928304 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928393 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928614 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928704 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.928922 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929011 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929224 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929533 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929620 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929838 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.929943 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.930163 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.930254 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.930468 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.930605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.930770 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.930867 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931070 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931158 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931371 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931458 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931678 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931775 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.931987 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.932078 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.932294 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.932382 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.932597 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.932699 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.932917 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933006 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933223 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933310 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933618 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933834 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.933922 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.934163 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.934255 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.934477 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.934568 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.934789 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.934887 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.935090 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.935180 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.935406 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.935748 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.935960 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936056 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936262 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936352 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936563 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936651 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936863 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.936951 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.937163 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.937261 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.937468 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.937558 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.937808 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.937905 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.938126 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.938429 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.938519 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.938729 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.938873 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939029 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939192 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939348 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939525 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939655 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939846 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.939955 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.940163 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.940262 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.940501 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.940634 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.940835 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.940924 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.941150 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.941241 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.941481 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.941570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.941810 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.941900 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.942145 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.942235 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.942452 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.942540 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.942761 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.942849 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943065 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943153 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943370 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943457 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943674 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943762 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.943979 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944067 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944279 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944374 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944583 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944685 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944888 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.944976 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.945188 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.945275 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.945493 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.945591 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.945810 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.945898 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.946137 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.946277 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.946442 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.946593 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.946746 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.946836 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.947049 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.947138 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.947384 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.947486 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.947687 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.947775 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948032 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948121 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948333 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948423 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948642 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948730 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.948952 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949041 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949256 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949353 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949564 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949652 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949871 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.949957 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.950226 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.950541 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.950637 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.950854 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.950942 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.951181 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.951280 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.951494 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.951584 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.951814 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.951903 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.952125 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.952228 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.952434 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.952522 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.952744 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.952839 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.953043 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.953139 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.953874 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.953969 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.954228 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.954493 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.954610 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.954842 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.954932 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.955151 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.955240 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.955470 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.955570 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.955777 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.955866 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.956083 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.956179 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.956393 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.956496 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.956696 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.956786 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957000 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957308 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957398 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957617 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957712 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.957921 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958027 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958252 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958344 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958555 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958651 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958866 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.958956 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.959171 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.959260 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.959471 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.959561 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.959770 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.959859 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.960075 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.960164 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.960390 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.960479 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.960698 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.960840 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961016 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961106 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961337 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961434 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961642 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961745 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.961943 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962064 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962281 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962369 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962587 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962688 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962889 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.962978 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.963191 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.963281 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.963494 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.963592 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.963800 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.963961 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.964116 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.964207 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.964413 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.964501 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.964724 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.964820 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965029 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965119 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965334 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965423 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965638 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965726 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.965942 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966061 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966270 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966361 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966678 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966890 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.966978 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.967196 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.967293 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.967505 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.967594 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.967812 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.967901 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.968113 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.968201 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.968416 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.968512 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.968733 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.968830 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.969091 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.969188 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.969398 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.969650 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.969739 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.969967 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.970121 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.970301 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.970472 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.970612 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.970710 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.970947 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.971175 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.971273 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.971513 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.971602 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.971835 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.971936 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.972157 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.972254 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.972468 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.972555 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.972779 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.972869 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.973087 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.973177 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.973408 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.973505 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.973721 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.973810 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974049 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974155 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974360 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974456 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974663 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974765 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.974965 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975061 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975274 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975362 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975575 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975676 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.975967 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.976179 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.976277 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.976483 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.976581 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.976782 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.976879 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.977082 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.977171 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.977380 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.977470 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.977680 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.977942 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.978070 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.978296 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.978402 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.978606 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.978695 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.978905 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979001 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979223 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979321 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979528 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979616 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979828 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.979924 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.980128 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.980226 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.980428 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.980519 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.980766 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.980865 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.981068 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.981177 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.981393 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.981483 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.981698 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.981795 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982022 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982114 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982336 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982476 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982642 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982740 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.982947 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983046 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983252 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983340 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983551 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983638 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983848 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.983945 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.984148 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.984236 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.984450 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.985049 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.985334 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.985436 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.985666 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.985898 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.986103 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.986266 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.986418 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.986577 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.986729 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.986905 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987033 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987217 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987342 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987524 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987644 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987830 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.987955 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.988136 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.988260 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.988480 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.988569 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.988784 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.988882 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.989121 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.989220 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.989425 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.989520 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.989723 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.989811 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990050 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990144 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990351 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990439 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990662 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.990964 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991062 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991267 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991367 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991659 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991876 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.991964 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.992178 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.992264 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.992475 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.992611 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.992787 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.992878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993093 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993181 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993393 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993489 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993692 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993782 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.993992 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.994097 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.994312 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.994411 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.994611 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.994700 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.994915 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995004 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995221 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995317 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995525 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995614 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995821 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.995910 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.996127 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.996228 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.996423 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.996510 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.996721 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.996815 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997015 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997111 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997317 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997406 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997612 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997707 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.997908 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998018 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998227 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998316 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998524 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998613 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998821 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.998917 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.999124 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.999212 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.999425 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.999514 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.999724 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:15.999813 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.000022 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.000120 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.000880 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.001095 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.001307 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.001614 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.001720 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.001947 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002078 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002284 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002385 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002595 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002709 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002907 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.002997 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.003215 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.003304 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.003523 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.003613 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.003826 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.003915 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.004123 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.004212 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.004427 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.004515 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.004732 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.004820 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005034 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005124 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005330 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005418 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005629 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005730 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.005930 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006039 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006261 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006363 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006561 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006658 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006862 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.006953 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.007178 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.007266 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.007483 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.007581 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.007785 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.007873 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008085 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008173 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008385 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008484 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008687 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008774 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.008989 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.009078 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.009294 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.009383 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.009601 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.009764 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.009909 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010052 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010236 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010327 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010543 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010632 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010848 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.010937 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.011148 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.011241 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.011455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.011573 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.011763 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.011875 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012062 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012161 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012369 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012466 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012741 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012859 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.012973 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013083 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013276 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013366 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013574 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013674 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.013976 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.014199 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.014303 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.014528 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.014630 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.014852 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.014943 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.015160 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.015250 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.015471 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.015570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.015776 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.015898 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.016110 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.016265 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.016407 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.016718 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.016807 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.017114 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.017203 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.017450 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.017548 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.017768 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.017858 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.018113 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.018219 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.018429 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.018533 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.018734 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.018823 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019036 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019125 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019344 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019510 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019653 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019743 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.019950 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020038 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020252 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020342 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020550 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020639 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020858 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.020954 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.021157 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.021253 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.021458 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.021562 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.021776 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.021878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.022099 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.022193 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.022477 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.022564 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.022821 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.022922 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.023131 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.023222 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.023433 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.023523 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.023742 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.023840 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024051 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024141 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024365 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024453 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024663 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024759 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.024967 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.025056 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.025268 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.025384 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.025593 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.025691 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.025915 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026022 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026245 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026334 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026556 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026662 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026854 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.026944 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.027172 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.027262 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.027488 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.027579 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.027797 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.027886 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.028098 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.028185 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.028401 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.028492 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.028723 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.028823 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.029026 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.029117 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.029346 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.029436 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.029724 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.029822 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030041 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030133 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030346 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030435 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030652 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030772 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.030954 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.031083 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.031254 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.031391 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.031623 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.031934 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032075 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032235 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032326 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032541 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032632 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032845 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.032942 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.033145 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.033242 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.033444 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.033534 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.033761 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.033851 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.034082 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.034174 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.034402 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.034494 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.034710 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.034799 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035027 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035117 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035343 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035434 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035643 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035733 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.035961 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.036054 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.036267 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.036347 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.036570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.036693 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.036869 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037019 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037172 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037334 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037509 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037655 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037809 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.037983 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.038146 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.038310 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.038475 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.038614 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.038799 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.038924 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.039104 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.039230 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.039432 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.039535 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.039751 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.039859 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.040061 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.040163 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.040432 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.040518 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.040755 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.040845 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041054 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041132 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041355 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041432 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041657 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041736 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.041955 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042111 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042278 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042357 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042577 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042668 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042880 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.042970 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.043178 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.043280 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.043474 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.043564 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.043771 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.043859 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044087 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044186 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044387 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044484 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044695 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044784 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.044996 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045093 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045295 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045384 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045596 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045693 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045893 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.045993 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.046256 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.046378 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.046554 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.046656 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.046883 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.046993 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.047726 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.047868 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.048046 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.048193 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.048515 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.048613 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.048830 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.048919 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.049152 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.049241 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.049467 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.049558 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.049782 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.049880 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.050120 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.050214 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.050434 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.050526 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.050745 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.050835 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051050 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051152 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051354 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051444 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051656 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051745 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.051957 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.052055 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.052263 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.052366 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.052565 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.052694 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.052888 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.053084 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.053210 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.053410 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.053501 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.053720 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.053810 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054039 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054167 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054352 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054481 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054664 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054790 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.054974 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.055091 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.055281 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.055397 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.055586 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.055716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.055893 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056011 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056198 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056314 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056523 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056645 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056826 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.056951 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.057146 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.057272 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.057467 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.057581 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.057776 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.057890 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.058109 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.058229 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.058941 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059031 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059124 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059217 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059308 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059469 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059559 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059649 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059740 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059824 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.059914 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.060000 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.060207 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.060308 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.060776 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.060873 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.061080 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.061311 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.061402 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.061645 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.061744 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.061964 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.062093 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.062295 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.062386 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.062602 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.062728 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.063697 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.063801 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.064052 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.064212 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.064377 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.064539 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.064709 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.064862 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065036 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065181 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065350 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065497 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065663 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065832 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.065977 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.066187 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.066515 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.066630 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.066829 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.066931 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.067157 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.067247 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.067474 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.067579 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.067791 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.067880 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.068104 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.068203 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.068417 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.068739 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.068829 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069040 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069129 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069338 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069436 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069645 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069744 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.069950 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070059 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070275 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070366 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070584 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070674 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070888 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.070976 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.071188 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.071286 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.071496 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.071592 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.071796 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.071892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.072106 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.072323 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.072414 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.072670 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.072759 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.072987 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.073085 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.073308 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.073398 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.073630 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.073709 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.073943 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.074061 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.074273 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.074375 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.074593 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.074806 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.074910 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.075126 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.075216 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.075464 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.075553 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.075765 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.075854 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076064 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076153 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076363 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076452 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076673 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076785 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.076978 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077079 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077275 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077374 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077579 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077678 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.077969 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.078222 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.078332 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.078594 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.078685 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.078945 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.079174 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.079389 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.079489 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.079703 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.079794 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080006 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080118 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080306 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080433 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080608 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080908 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.080997 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.081220 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.081311 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.081520 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.081611 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.081825 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.081914 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.082147 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.082276 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.082462 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.082598 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.082761 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.082907 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.083068 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.083233 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.083414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.083543 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.083734 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.083836 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084034 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084138 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084332 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084449 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084642 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084753 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.084948 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085046 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085266 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085356 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085576 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085673 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085884 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.085982 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.086247 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.086341 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.086559 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.086650 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.086886 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.087088 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.087187 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.087421 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.087512 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.087742 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.087840 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088070 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088157 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088375 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088465 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088782 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.088979 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089068 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089280 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089368 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089593 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089765 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089897 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.089987 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.090225 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.090314 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.090528 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.090618 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.090831 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.090925 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.091131 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.091219 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.091434 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.091523 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.091738 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.091869 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092043 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092132 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092346 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092436 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092652 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092741 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.092955 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.093052 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.093257 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.093348 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.093566 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.093662 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.093884 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.094021 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.094312 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.094620 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.094711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.094929 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.095017 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.095243 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.095336 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.095549 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.095831 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.095930 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.096161 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.096259 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.096467 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.096560 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.096779 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.096884 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.097107 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.097209 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.097413 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.097511 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.097711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.097802 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.098045 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.098151 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.098375 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.098465 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.098693 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.098784 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099008 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099107 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099319 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099409 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099628 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099726 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.099938 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100028 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100248 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100338 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100557 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100655 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100863 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.100959 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.101171 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.101260 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.101479 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.101577 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.101787 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.101878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.102121 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.102216 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.102441 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.102533 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.102780 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.102870 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.103080 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.103167 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.103387 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.103477 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.103700 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.103797 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104004 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104094 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104302 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104392 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104601 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104690 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.104905 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105001 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105205 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105303 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105506 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105596 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105807 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.105905 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.106133 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.106238 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.106439 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.106535 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.106736 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.106836 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107034 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107139 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107333 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107456 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107627 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107777 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.107926 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.108088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.108225 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.108410 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.108515 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.108734 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.108825 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.109046 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.109137 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.109365 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.109465 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.110233 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.110330 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.110536 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.110886 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.110987 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.111197 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.111297 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.111509 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.111599 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.111826 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.111915 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.112133 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.112224 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.112451 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.112544 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.112755 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.112854 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113116 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113213 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113388 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113484 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113694 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113793 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.113996 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.114191 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.114324 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.114413 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.114634 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.114735 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.114941 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115031 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115245 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115343 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115551 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115654 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115853 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.115942 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.116156 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.116244 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.116456 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.116545 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.116760 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.116851 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117062 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117153 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117369 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117490 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117674 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117776 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.117974 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.118141 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.118306 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.118396 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.118606 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.118695 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.118912 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119076 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119213 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119304 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119514 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119604 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119814 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.119913 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.120119 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.120216 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.120427 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.120517 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.120740 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.120838 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121053 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121145 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121363 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121451 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121686 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121788 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.121995 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.122141 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.122337 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.122427 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.122655 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.122752 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.122973 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.123062 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.123280 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.123371 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.123612 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.123703 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.123922 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124019 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124231 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124322 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124538 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124628 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124837 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.124932 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.125078 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 22:32:16.125207 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.125647 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.126226 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.126566 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.126877 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.127206 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.127533 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.127855 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.128174 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.128490 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.128822 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.129134 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.129446 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.129765 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.130099 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.130416 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.130734 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.131051 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.131378 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.131705 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.132016 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.132343 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.132672 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.133024 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.133339 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.133681 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.134023 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.134348 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.134662 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.134968 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:32:16.135209 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 22:32:16.183559 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO dbcounter [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Registered counter for database nova_api May 18 22:32:16.195716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO dbcounter [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Registered counter for database nova_api May 18 22:32:16.204637 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.211050 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writer thread running {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.217642 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_db.sqlalchemy.engines [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.224987 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writer thread running {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.267161 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.context [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a5ec003-2fee-4752-99af-302cbb09e086(cell1) {{(pid=109892) load_cells /opt/stack/nova/nova/context.py:464}} May 18 22:32:16.272582 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:32:16.274155 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:32:16.274944 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:32:16.276905 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:32:16.278869 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO dbcounter [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Registered counter for database nova_cell0 May 18 22:32:16.281229 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.context [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a5ec003-2fee-4752-99af-302cbb09e086(cell1) {{(pid=109891) load_cells /opt/stack/nova/nova/context.py:464}} May 18 22:32:16.282846 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO dbcounter [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Registered counter for database nova_cell1 May 18 22:32:16.287084 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_concurrency.lockutils [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:32:16.288678 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_concurrency.lockutils [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:32:16.289493 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_concurrency.lockutils [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:32:16.290564 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.291511 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_concurrency.lockutils [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:32:16.292842 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.293523 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO dbcounter [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Registered counter for database nova_cell0 May 18 22:32:16.297841 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO dbcounter [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Registered counter for database nova_cell1 May 18 22:32:16.298585 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writer thread running {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.300654 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writer thread running {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.305102 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_db.sqlalchemy.engines [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.306849 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_db.sqlalchemy.engines [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.313538 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writer thread running {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.315573 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writer thread running {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.447800 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO dbcounter [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Registered counter for database nova_cell0 May 18 22:32:16.457560 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_db.sqlalchemy.engines [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.460004 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO dbcounter [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Registered counter for database nova_cell0 May 18 22:32:16.462016 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writer thread running {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.468526 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG oslo_db.sqlalchemy.engines [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:32:16.472991 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writer thread running {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:32:16.891325 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: WARNING keystonemiddleware.auth_token [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:32:16.898668 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: WARNING keystonemiddleware.auth_token [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:32:16.927906 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: WARNING keystonemiddleware.auth_token [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:32:16.935869 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: WARNING keystonemiddleware.auth_token [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:32:17.242824 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: WARNING keystonemiddleware.auth_token [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:32:17.248822 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: WARNING keystonemiddleware.auth_token [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:32:17.254659 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56472fd599c0 pid: 109892 (default app) May 18 22:32:17.256705 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:32:17.257882 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 May 18 22:32:17.258324 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Wed May 18 22:32:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:32:17.286664 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: WARNING keystonemiddleware.auth_token [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:32:17.292732 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: WARNING keystonemiddleware.auth_token [None req-05df4366-3156-4cd8-97a0-4c18692cfc20 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:32:17.298835 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56472fd599c0 pid: 109891 (default app) May 18 22:33:37.784851 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:37.785840 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 18 22:33:37.786314 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:37.803237 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writing DB stats nova_api:SELECT=3 {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:37.804858 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writing DB stats nova_cell0:SELECT=3 {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:37.805852 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writing DB stats nova_cell1:SELECT=3 {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:37.806908 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:38.259941 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-3780a629-679c-4004-a55b-c7d9ceec8acd admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:38.289877 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-3780a629-679c-4004-a55b-c7d9ceec8acd admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.496767 May 18 22:33:38.290686 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1291 bytes} [Wed May 18 22:33:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:40.578151 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:40.579200 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-4dc78a2c-cd78-4243-988c-01770957559e None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 18 22:33:40.579584 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:40.639588 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-a9a596e8-0f25-4b49-816c-46edb28bbab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "rxtx_factor": 1.0}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:40.659305 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:33:40.659305 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: warnings.warn(msg) May 18 22:33:40.751194 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-a9a596e8-0f25-4b49-816c-46edb28bbab0 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165164 May 18 22:33:40.752081 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:33:40.765102 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_api:SELECT=3 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:40.766256 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_cell1:SELECT=3 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:40.767935 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_cell0:SELECT=3 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:40.768651 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:33:40.969856 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-92ec2c45-96ff-483a-8b26-97e43b174a80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:40.972375 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:33:40.972375 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: warnings.warn(msg) May 18 22:33:41.103211 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-92ec2c45-96ff-483a-8b26-97e43b174a80 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.343348 May 18 22:33:41.104000 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1335 bytes} [Wed May 18 22:33:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:43.446464 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-a9a596e8-0f25-4b49-816c-46edb28bbab0 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:43.447515 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-a9a596e8-0f25-4b49-816c-46edb28bbab0 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 18 22:33:43.447913 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:43.590880 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-528ec38f-7b20-468d-8a9c-06b12376a440 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "disk": 5}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:43.608954 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:33:43.608954 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: warnings.warn(msg) May 18 22:33:43.701351 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-528ec38f-7b20-468d-8a9c-06b12376a440 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.246108 May 18 22:33:43.701841 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 22:33:43.714116 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-5e30d7ea-2ece-4996-9d90-e6fdc709574c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:43.715575 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:33:43.715575 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: warnings.warn(msg) May 18 22:33:43.813719 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-5e30d7ea-2ece-4996-9d90-e6fdc709574c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103281 May 18 22:33:43.814552 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1335 bytes} [Wed May 18 22:33:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:46.127925 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-528ec38f-7b20-468d-8a9c-06b12376a440 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:46.129539 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-528ec38f-7b20-468d-8a9c-06b12376a440 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 May 18 22:33:46.130431 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:46.194646 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-09be1ff3-77cb-4202-9c98-49f84c88fa9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:46.279289 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-09be1ff3-77cb-4202-9c98-49f84c88fa9a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142339 May 18 22:33:46.280124 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:33:46.292592 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-239508d7-4f17-4365-9e28-826f7c1ea911 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:46.368190 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-239508d7-4f17-4365-9e28-826f7c1ea911 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079122 May 18 22:33:46.368686 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1335 bytes} [Wed May 18 22:33:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:48.659876 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-09be1ff3-77cb-4202-9c98-49f84c88fa9a admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:48.660891 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-09be1ff3-77cb-4202-9c98-49f84c88fa9a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 18 22:33:48.661292 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:48.724356 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-e14af352-3d2f-4f32-b7d5-9874aa86f887 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:48.775685 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-e14af352-3d2f-4f32-b7d5-9874aa86f887 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.108127 May 18 22:33:48.776241 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:33:48.788487 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-f3257607-cc61-46d8-b380-121c8aa7512c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:48.876471 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-f3257607-cc61-46d8-b380-121c8aa7512c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091318 May 18 22:33:48.877170 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1335 bytes} [Wed May 18 22:33:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:51.153605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-e14af352-3d2f-4f32-b7d5-9874aa86f887 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:51.154725 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-e14af352-3d2f-4f32-b7d5-9874aa86f887 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 May 18 22:33:51.155194 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:51.216417 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-f2bf44bc-de55-4505-b5f4-eeaa18342f32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "ram": 4096}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:51.295274 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-f2bf44bc-de55-4505-b5f4-eeaa18342f32 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133772 May 18 22:33:51.296086 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:33:51.308214 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-90c1f117-d975-470d-bc14-c5c32b5d410a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:51.384785 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-90c1f117-d975-470d-bc14-c5c32b5d410a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080136 May 18 22:33:51.385430 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1335 bytes} [Wed May 18 22:33:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:53.651078 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-f2bf44bc-de55-4505-b5f4-eeaa18342f32 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:53.651982 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-f2bf44bc-de55-4505-b5f4-eeaa18342f32 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 18 22:33:53.652574 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:33:53.720696 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-6d0c63a0-b6c5-43a5-a53e-7bc07cdba411 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:53.746196 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-6d0c63a0-b6c5-43a5-a53e-7bc07cdba411 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085862 May 18 22:33:53.746749 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1291 bytes} [Wed May 18 22:33:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:33:56.022775 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-f2bf44bc-de55-4505-b5f4-eeaa18342f32 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:56.023786 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-f2bf44bc-de55-4505-b5f4-eeaa18342f32 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 18 22:33:56.024190 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:56.097762 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-9a7cd677-e5ea-4a61-8c4b-d9518ac59e65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "vcpus": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:56.174318 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-9a7cd677-e5ea-4a61-8c4b-d9518ac59e65 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.144046 May 18 22:33:56.174878 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:33:56.186725 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-8a7797e9-bb86-4be0-8446-ed631e907826 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:56.264378 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-8a7797e9-bb86-4be0-8446-ed631e907826 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081408 May 18 22:33:56.264895 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1332 bytes} [Wed May 18 22:33:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:33:59.099247 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-9a7cd677-e5ea-4a61-8c4b-d9518ac59e65 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:33:59.100317 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-9a7cd677-e5ea-4a61-8c4b-d9518ac59e65 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 18 22:33:59.100713 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:33:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:33:59.163882 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-20e67960-36a2-4609-9005-db2f19b7397f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "vcpus": 1, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:59.231958 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-20e67960-36a2-4609-9005-db2f19b7397f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.125490 May 18 22:33:59.232532 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:33:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:33:59.246079 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-a224c362-98f6-4238-b608-1241fb4f1a57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:33:59.317771 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-a224c362-98f6-4238-b608-1241fb4f1a57 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075512 May 18 22:33:59.318428 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1332 bytes} [Wed May 18 22:33:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:34:01.838553 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-20e67960-36a2-4609-9005-db2f19b7397f admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:01.839627 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-20e67960-36a2-4609-9005-db2f19b7397f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 18 22:34:01.840055 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:34:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:01.898798 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-9c6d137d-1005-45b6-8b7e-36f6adbfcbcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:01.993194 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-9c6d137d-1005-45b6-8b7e-36f6adbfcbcf admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.146915 May 18 22:34:01.993744 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:34:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:34:02.006547 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-d970a4fe-f73c-416a-9f5d-06d87560c8b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:02.082530 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-d970a4fe-f73c-416a-9f5d-06d87560c8b9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079967 May 18 22:34:02.083466 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1332 bytes} [Wed May 18 22:34:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:34:04.368862 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-9c6d137d-1005-45b6-8b7e-36f6adbfcbcf admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:04.369862 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-9c6d137d-1005-45b6-8b7e-36f6adbfcbcf admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 18 22:34:04.370323 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:04.427429 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-4f7f5bcb-6123-4ba2-8f30-b4797fb6043f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:04.546021 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-4f7f5bcb-6123-4ba2-8f30-b4797fb6043f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.169443 May 18 22:34:04.546582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:34:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 22:34:04.559089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-fafdc489-6294-4182-9eca-ebadddedbf86 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:04.666999 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-fafdc489-6294-4182-9eca-ebadddedbf86 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111533 May 18 22:34:04.667581 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1332 bytes} [Wed May 18 22:34:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:34:06.976234 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-4f7f5bcb-6123-4ba2-8f30-b4797fb6043f admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:06.977292 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-4f7f5bcb-6123-4ba2-8f30-b4797fb6043f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 18 22:34:06.977672 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:07.043828 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-41ede5e1-e130-4f0a-9243-76f4d028f017 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:07.135078 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-41ede5e1-e130-4f0a-9243-76f4d028f017 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.151584 May 18 22:34:07.135896 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1282 bytes} [Wed May 18 22:34:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:34:07.148221 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-a5d2e17f-8cd4-46e4-95bc-e60867666502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:07.235988 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-a5d2e17f-8cd4-46e4-95bc-e60867666502 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091465 May 18 22:34:07.236595 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1332 bytes} [Wed May 18 22:34:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:34:32.587616 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-41ede5e1-e130-4f0a-9243-76f4d028f017 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:32.588635 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-41ede5e1-e130-4f0a-9243-76f4d028f017 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 18 22:34:32.589027 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:32.600221 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:32.649388 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-189b4210-16ed-450d-8f27-27a811cad64e admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:32.666779 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-189b4210-16ed-450d-8f27-27a811cad64e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071734 May 18 22:34:32.667298 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1291 bytes} [Wed May 18 22:34:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:33.671796 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-41ede5e1-e130-4f0a-9243-76f4d028f017 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:33.672803 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-41ede5e1-e130-4f0a-9243-76f4d028f017 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 18 22:34:33.673251 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:33.874725 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-9ba8b092-fb41-4c3c-b6a9-e31c8a737294 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:33.881106 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.wsgi [None req-9ba8b092-fb41-4c3c-b6a9-e31c8a737294 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-9ba8b092-fb41-4c3c-b6a9-e31c8a737294 admin admin] Request method failure captured: May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Accept: application/json May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Accept-Encoding: gzip, deflate May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Connection: keep-alive May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Content-Length: 0 May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Host: 10.222.0.70 May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Openstack-Api-Version: compute 2.90 May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Openstack-System-Scope: None May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: User-Agent: python-novaclient May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Auth-Token: gAAAAABihXR5k2fuMjkWBmlHyj_Cu5o5HPpELBrBM1Z_P-csYkxtPu0DGqScWrLXzlYybDs4IXzoJJnYDztzq2vKPYeDG2LVnAYxJvTx9UUeBhaywcxB5J34FWdJmGoPddobKJ9gn_vCSBYhC_2dRwLCA_Yqo2j7N4UdcIZme3T7KpWTI4U8eyE May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Domain-Id: None May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Domain-Name: None May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Identity-Status: Confirmed May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Is-Admin-Project: True May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Openstack-Nova-Api-Version: 2.90 May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Domain-Id: default May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Domain-Name: Default May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Name: admin May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Role: reader,member,admin May 18 22:34:33.884313 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Roles: reader,member,admin May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8c35a2b52a5945feba11f71adc84e226", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8c35a2b52a5945feba11f71adc84e226"}]}] May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant: admin May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant-Name: admin May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User: admin May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Domain-Id: default May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Domain-Name: Default May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Id: 45cbea53fb4d428dbebc3700d01065fb May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Name: admin May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: method: > May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: exception: Flavor 42 could not be found. May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: action_args: {'id': '42'} May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:34:33.885892 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:33.891088 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:33.892716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-9ba8b092-fb41-4c3c-b6a9-e31c8a737294 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:34:33.894105 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-9ba8b092-fb41-4c3c-b6a9-e31c8a737294 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062643 May 18 22:34:33.894105 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Wed May 18 22:34:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 22:34:33.895610 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-886021df-ce15-4ba0-aed5-85add4c76904 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:33.898572 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:34:33.916895 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-886021df-ce15-4ba0-aed5-85add4c76904 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024904 May 18 22:34:33.917436 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Wed May 18 22:34:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:33.927924 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-065d9812-a11a-40c8-9cca-7989ca170a2c admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:33.950043 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-065d9812-a11a-40c8-9cca-7989ca170a2c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025747 May 18 22:34:33.950572 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Wed May 18 22:34:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:33.960181 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-7c34fec6-77b5-4eba-b13b-ae65f3c4074f admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:33.966331 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.wsgi [None req-7c34fec6-77b5-4eba-b13b-ae65f3c4074f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-7c34fec6-77b5-4eba-b13b-ae65f3c4074f admin admin] Request method failure captured: May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Accept: application/json May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Accept-Encoding: gzip, deflate May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Connection: keep-alive May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Content-Length: 0 May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Host: 10.222.0.70 May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Openstack-Api-Version: compute 2.90 May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Openstack-System-Scope: None May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: User-Agent: python-novaclient May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Auth-Token: gAAAAABihXR5k2fuMjkWBmlHyj_Cu5o5HPpELBrBM1Z_P-csYkxtPu0DGqScWrLXzlYybDs4IXzoJJnYDztzq2vKPYeDG2LVnAYxJvTx9UUeBhaywcxB5J34FWdJmGoPddobKJ9gn_vCSBYhC_2dRwLCA_Yqo2j7N4UdcIZme3T7KpWTI4U8eyE May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Domain-Id: None May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Domain-Name: None May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Identity-Status: Confirmed May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Is-Admin-Project: True May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Openstack-Nova-Api-Version: 2.90 May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Domain-Id: default May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Domain-Name: Default May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Name: admin May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Role: reader,member,admin May 18 22:34:33.969529 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Roles: reader,member,admin May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8c35a2b52a5945feba11f71adc84e226", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8c35a2b52a5945feba11f71adc84e226"}]}] May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant: admin May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant-Name: admin May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User: admin May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Domain-Id: default May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Domain-Name: Default May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Id: 45cbea53fb4d428dbebc3700d01065fb May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Name: admin May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: method: > May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: exception: Flavor 42 could not be found. May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: action_args: {'id': '42'} May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:34:33.982567 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:33.983605 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:33.984949 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-7c34fec6-77b5-4eba-b13b-ae65f3c4074f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:34:33.987243 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-7c34fec6-77b5-4eba-b13b-ae65f3c4074f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015002 May 18 22:34:33.987243 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Wed May 18 22:34:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 22:34:34.855940 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-065d9812-a11a-40c8-9cca-7989ca170a2c admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:34.856948 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-065d9812-a11a-40c8-9cca-7989ca170a2c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 18 22:34:34.857348 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:34:35.049736 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-8d1af820-8bca-4ca0-9a07-5b31a72209ff admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:35.055053 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.wsgi [None req-8d1af820-8bca-4ca0-9a07-5b31a72209ff admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-8d1af820-8bca-4ca0-9a07-5b31a72209ff admin admin] Request method failure captured: May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Accept: application/json May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Accept-Encoding: gzip, deflate May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Connection: keep-alive May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Content-Length: 0 May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Host: 10.222.0.70 May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Openstack-Api-Version: compute 2.90 May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Openstack-System-Scope: None May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: User-Agent: python-novaclient May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Auth-Token: gAAAAABihXR6R4DprTyrRseIg7yqPw_mDwwpZ34NLTafONpeGMb2N4bc10QUMNgCDsGCB8dseB4fBot1gUaWXMcC-xjllwJexULxMhanjYEBHwhWCG-0U6SOqck9LJO7cSohXZVdNE-_xn6LxPyWahgtnwpzVFlijgKJl4PF-H2DdeEeSSwyADs May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Domain-Id: None May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Domain-Name: None May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Identity-Status: Confirmed May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Is-Admin-Project: True May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Openstack-Nova-Api-Version: 2.90 May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Domain-Id: default May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Domain-Name: Default May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Name: admin May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Role: reader,member,admin May 18 22:34:35.056570 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Roles: reader,member,admin May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8c35a2b52a5945feba11f71adc84e226", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8c35a2b52a5945feba11f71adc84e226"}]}] May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant: admin May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant-Name: admin May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User: admin May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Domain-Id: default May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Domain-Name: Default May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Id: 45cbea53fb4d428dbebc3700d01065fb May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Name: admin May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: method: > May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: exception: Flavor 84 could not be found. May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: action_args: {'id': '84'} May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:34:35.058089 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:35.059221 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:35.060701 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-8d1af820-8bca-4ca0-9a07-5b31a72209ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:34:35.062143 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-8d1af820-8bca-4ca0-9a07-5b31a72209ff admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062374 May 18 22:34:35.062143 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Wed May 18 22:34:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 22:34:35.068900 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-ca7e08f0-42ff-48a2-933b-6d2fbd5925be admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:35.083331 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-ca7e08f0-42ff-48a2-933b-6d2fbd5925be admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018469 May 18 22:34:35.083851 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Wed May 18 22:34:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:35.093308 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-be1bace6-10dd-46e3-abf6-39f0b6cc6432 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:35.107184 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-be1bace6-10dd-46e3-abf6-39f0b6cc6432 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017704 May 18 22:34:35.107696 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Wed May 18 22:34:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:35.116870 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-e9a66d1e-befb-4f2c-a4e4-d9c85bf8e1fb admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:35.122095 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.wsgi [None req-e9a66d1e-befb-4f2c-a4e4-d9c85bf8e1fb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-e9a66d1e-befb-4f2c-a4e4-d9c85bf8e1fb admin admin] Request method failure captured: May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Accept: application/json May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Accept-Encoding: gzip, deflate May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Connection: keep-alive May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Content-Length: 0 May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Host: 10.222.0.70 May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Openstack-Api-Version: compute 2.90 May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Openstack-System-Scope: None May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: User-Agent: python-novaclient May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Auth-Token: gAAAAABihXR6R4DprTyrRseIg7yqPw_mDwwpZ34NLTafONpeGMb2N4bc10QUMNgCDsGCB8dseB4fBot1gUaWXMcC-xjllwJexULxMhanjYEBHwhWCG-0U6SOqck9LJO7cSohXZVdNE-_xn6LxPyWahgtnwpzVFlijgKJl4PF-H2DdeEeSSwyADs May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Domain-Id: None May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Domain-Name: None May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Identity-Status: Confirmed May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Is-Admin-Project: True May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Openstack-Nova-Api-Version: 2.90 May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Domain-Id: default May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Domain-Name: Default May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Name: admin May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Role: reader,member,admin May 18 22:34:35.123582 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Roles: reader,member,admin May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8c35a2b52a5945feba11f71adc84e226", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8c35a2b52a5945feba11f71adc84e226"}]}] May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant: admin May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant-Name: admin May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User: admin May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Domain-Id: default May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Domain-Name: Default May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Id: 45cbea53fb4d428dbebc3700d01065fb May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Name: admin May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: method: > May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: exception: Flavor 84 could not be found. May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: action_args: {'id': '84'} May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:34:35.125152 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:35.126750 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:35.128200 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-e9a66d1e-befb-4f2c-a4e4-d9c85bf8e1fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:34:35.129467 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-e9a66d1e-befb-4f2c-a4e4-d9c85bf8e1fb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011484 May 18 22:34:35.129684 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Wed May 18 22:34:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 22:34:36.016781 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-be1bace6-10dd-46e3-abf6-39f0b6cc6432 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:36.018260 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-be1bace6-10dd-46e3-abf6-39f0b6cc6432 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001871 May 18 22:34:36.018659 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:36.211672 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-d5d8ed28-08a4-4478-bafa-381d2971ea3a admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:36.216914 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.wsgi [None req-d5d8ed28-08a4-4478-bafa-381d2971ea3a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-d5d8ed28-08a4-4478-bafa-381d2971ea3a admin admin] Request method failure captured: May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Accept: application/json May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Accept-Encoding: gzip, deflate May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Connection: keep-alive May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Content-Length: 0 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Host: 10.222.0.70 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Openstack-Api-Version: compute 2.90 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Openstack-System-Scope: None May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: User-Agent: python-novaclient May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Auth-Token: gAAAAABihXR87UYntlp-H8tgnhAdMiKTQINrC4LhZv_AHNE71HOn3BY611QBt7QceOr_MTMsDsDssIi4WNlICelqc3Q05k5lVr1I2Ctx4FY9xnyq-al5prGyDzUlkL2X5LKR8VDmKGqK52rn2NmmxVjueH5nrMoXPY7rU9ZdZVLjkeyIfNjpe60 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Domain-Id: None May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Domain-Name: None May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Identity-Status: Confirmed May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Is-Admin-Project: True May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Openstack-Nova-Api-Version: 2.90 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Domain-Id: default May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Domain-Name: Default May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Project-Name: admin May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Role: reader,member,admin May 18 22:34:36.218421 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Roles: reader,member,admin May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8c35a2b52a5945feba11f71adc84e226", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8c35a2b52a5945feba11f71adc84e226"}]}] May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant: admin May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-Tenant-Name: admin May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User: admin May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Domain-Id: default May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Domain-Name: Default May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Id: 45cbea53fb4d428dbebc3700d01065fb May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: X-User-Name: admin May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: method: > May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: exception: Flavor 451 could not be found. May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: action_args: {'id': '451'} May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:34:36.220057 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:36.221151 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: ERROR nova.api.openstack.wsgi May 18 22:34:36.222679 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-d5d8ed28-08a4-4478-bafa-381d2971ea3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:34:36.223973 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-d5d8ed28-08a4-4478-bafa-381d2971ea3a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060404 May 18 22:34:36.223973 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Wed May 18 22:34:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 22:34:36.229296 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-d14a3fd1-cc22-4fbb-9f95-751649a7d95c admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:36.243639 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-d14a3fd1-cc22-4fbb-9f95-751649a7d95c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017898 May 18 22:34:36.244160 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Wed May 18 22:34:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:36.255978 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:36.269039 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019218 May 18 22:34:36.269554 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Wed May 18 22:34:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:34:36.278525 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-6c6a1413-6071-4644-84a9-c0049bcc8673 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:36.284341 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.wsgi [None req-6c6a1413-6071-4644-84a9-c0049bcc8673 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-6c6a1413-6071-4644-84a9-c0049bcc8673 admin admin] Request method failure captured: May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Accept: application/json May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Accept-Encoding: gzip, deflate May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Connection: keep-alive May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Content-Length: 0 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Host: 10.222.0.70 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Openstack-Api-Version: compute 2.90 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Openstack-System-Scope: None May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: User-Agent: python-novaclient May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Auth-Token: gAAAAABihXR87UYntlp-H8tgnhAdMiKTQINrC4LhZv_AHNE71HOn3BY611QBt7QceOr_MTMsDsDssIi4WNlICelqc3Q05k5lVr1I2Ctx4FY9xnyq-al5prGyDzUlkL2X5LKR8VDmKGqK52rn2NmmxVjueH5nrMoXPY7rU9ZdZVLjkeyIfNjpe60 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Domain-Id: None May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Domain-Name: None May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Identity-Status: Confirmed May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Is-Admin-Project: True May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Openstack-Nova-Api-Version: 2.90 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Domain-Id: default May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Domain-Name: Default May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Project-Name: admin May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Role: reader,member,admin May 18 22:34:36.285818 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Roles: reader,member,admin May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8c35a2b52a5945feba11f71adc84e226", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8c35a2b52a5945feba11f71adc84e226"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8c35a2b52a5945feba11f71adc84e226"}]}] May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant: admin May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant-Id: 8c35a2b52a5945feba11f71adc84e226 May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-Tenant-Name: admin May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User: admin May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Domain-Id: default May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Domain-Name: Default May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Id: 45cbea53fb4d428dbebc3700d01065fb May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: X-User-Name: admin May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: method: > May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: exception: Flavor 451 could not be found. May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: action_args: {'id': '451'} May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:34:36.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:36.288414 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: ERROR nova.api.openstack.wsgi May 18 22:34:36.289711 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-6c6a1413-6071-4644-84a9-c0049bcc8673 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:34:36.291011 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-6c6a1413-6071-4644-84a9-c0049bcc8673 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012120 May 18 22:34:36.291011 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Wed May 18 22:34:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 22:34:37.175034 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:37.176030 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 18 22:34:37.176449 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:37.365235 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-c69758b7-7ba4-464d-a73b-c93a63bd130c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:37.488667 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-c69758b7-7ba4-464d-a73b-c93a63bd130c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.175430 May 18 22:34:37.489247 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Wed May 18 22:34:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:34:38.387108 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:38.388143 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 18 22:34:38.388534 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:34:38.575677 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-33bd8934-e377-411e-8b73-a308b4c3ca6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:38.653380 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-33bd8934-e377-411e-8b73-a308b4c3ca6d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.129845 May 18 22:34:38.653850 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Wed May 18 22:34:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:34:39.553849 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:39.554886 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 18 22:34:39.555286 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:39.745302 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-7ecfe449-dab8-41d4-b0e5-2d3de8096063 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:39.832016 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-7ecfe449-dab8-41d4-b0e5-2d3de8096063 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.137565 May 18 22:34:39.832486 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Wed May 18 22:34:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:34:40.714784 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:40.715773 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 18 22:34:40.716161 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:34:40.904925 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-dcf04bbb-139e-4100-8ae6-5f723f4f1c81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:34:40.967739 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-dcf04bbb-139e-4100-8ae6-5f723f4f1c81 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.115112 May 18 22:34:40.968185 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Wed May 18 22:34:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 22:34:41.936751 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:41.937751 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 18 22:34:41.938172 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:34:42.129498 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-5333be8e-9fe6-4619-a78a-607ccc256bf7 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:34:42.148927 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-5333be8e-9fe6-4619-a78a-607ccc256bf7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072442 May 18 22:34:42.149392 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Wed May 18 22:34:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:35:44.130094 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:35:44.131082 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-af44d4f0-10a2-425b-9a30-cb90cb8331d5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 18 22:35:44.131502 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 930 bytes} [Wed May 18 22:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:35:44.138712 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:35:44.191862 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-821db843-13c8-4a8e-a135-b1bdb47a059b admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:35:44.211311 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-821db843-13c8-4a8e-a135-b1bdb47a059b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074022 May 18 22:35:44.211839 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1291 bytes} [Wed May 18 22:35:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:35:44.231961 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG dbcounter [-] [109891] Writing DB stats nova_api:SELECT=14 {{(pid=109891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:35:44.235594 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-1dd001ea-6c25-4071-9ab4-c5ed74f147b2 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:35:44.246683 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-1dd001ea-6c25-4071-9ab4-c5ed74f147b2 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016089 May 18 22:35:44.247213 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1282 bytes} [Wed May 18 22:35:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:35:44.259147 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-10275eeb-a5b0-4733-bc0e-97576d37c20a admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:35:44.267682 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-10275eeb-a5b0-4733-bc0e-97576d37c20a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012299 May 18 22:35:44.268191 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1285 bytes} [Wed May 18 22:35:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:35:44.279307 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:35:44.286974 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011237 May 18 22:35:44.287489 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1285 bytes} [Wed May 18 22:35:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:35:44.298921 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-4c560ddc-850d-4be4-8d99-7d2a79a04f11 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:35:44.306294 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-4c560ddc-850d-4be4-8d99-7d2a79a04f11 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011464 May 18 22:35:44.306799 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1282 bytes} [Wed May 18 22:35:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:39:22.582834 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:22.583836 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 18 22:39:22.584232 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:39:22.749453 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_api:SELECT=6 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:22.865387 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-4d490ad2-3b9c-4d6f-b689-c45797221e78 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:22.866583 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:39:22.866583 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: warnings.warn(msg) May 18 22:39:22.867774 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4d490ad2-3b9c-4d6f-b689-c45797221e78 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:22.868213 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4d490ad2-3b9c-4d6f-b689-c45797221e78 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:22.868996 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4d490ad2-3b9c-4d6f-b689-c45797221e78 admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:22.869420 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-4d490ad2-3b9c-4d6f-b689-c45797221e78 admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:22.902305 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-4d490ad2-3b9c-4d6f-b689-c45797221e78 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155118 May 18 22:39:22.902852 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Wed May 18 22:39:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:39:23.806712 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:23.807714 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 May 18 22:39:23.808107 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:39:23.998548 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-030a7918-edc5-4dba-9e11-bd4a70784344 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:24.000380 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:39:24.000380 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: warnings.warn(msg) May 18 22:39:24.001550 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-030a7918-edc5-4dba-9e11-bd4a70784344 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:24.001983 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-030a7918-edc5-4dba-9e11-bd4a70784344 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:24.002794 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-030a7918-edc5-4dba-9e11-bd4a70784344 admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:24.003227 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-030a7918-edc5-4dba-9e11-bd4a70784344 admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:24.022509 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-030a7918-edc5-4dba-9e11-bd4a70784344 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075119 May 18 22:39:24.023061 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Wed May 18 22:39:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:39:35.364109 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:35.365141 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 18 22:39:35.365529 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 36/73] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:39:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:39:35.510447 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_cell0:SELECT=4 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:35.511175 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_cell1:SELECT=4 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:35.511785 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG dbcounter [-] [109892] Writing DB stats nova_api:SELECT=8 {{(pid=109892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:39:35.559864 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-e4f92b9f-d440-4af0-a16f-29cbcecda64f admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:35.561717 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:39:35.561717 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: warnings.warn(msg) May 18 22:39:35.563104 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-e4f92b9f-d440-4af0-a16f-29cbcecda64f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:35.563547 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-e4f92b9f-d440-4af0-a16f-29cbcecda64f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:35.564399 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-e4f92b9f-d440-4af0-a16f-29cbcecda64f admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:35.564830 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-e4f92b9f-d440-4af0-a16f-29cbcecda64f admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:35.590247 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-e4f92b9f-d440-4af0-a16f-29cbcecda64f admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084088 May 18 22:39:35.590733 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 38/74] 10.222.0.70 () {60 vars in 1193 bytes} [Wed May 18 22:39:35 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:39:36.473695 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: DEBUG nova.api.openstack.wsgi [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] Calling method '>' {{(pid=109891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:36.474716 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: INFO nova.api.openstack.requestlog [None req-929d3b63-39dd-4a97-b8b4-935804ae0792 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 18 22:39:36.475107 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: [pid: 109891|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1074 bytes} [Wed May 18 22:39:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:39:36.664434 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG nova.api.openstack.wsgi [None req-8aa2ab9a-a665-45b9-a0b5-6859fb7ca3f4 admin admin] Calling method '>' {{(pid=109892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:39:36.665593 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 22:39:36.665593 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: warnings.warn(msg) May 18 22:39:36.666793 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-8aa2ab9a-a665-45b9-a0b5-6859fb7ca3f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:36.667275 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-8aa2ab9a-a665-45b9-a0b5-6859fb7ca3f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:36.668090 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-8aa2ab9a-a665-45b9-a0b5-6859fb7ca3f4 admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:39:36.668513 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: DEBUG oslo_concurrency.lockutils [None req-8aa2ab9a-a665-45b9-a0b5-6859fb7ca3f4 admin admin] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:39:36.691314 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: INFO nova.api.openstack.requestlog [None req-8aa2ab9a-a665-45b9-a0b5-6859fb7ca3f4 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078465 May 18 22:39:36.691803 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: [pid: 109892|app: 0|req: 39/76] 10.222.0.70 () {60 vars in 1193 bytes} [Wed May 18 22:39:36 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:40:35.024322 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: Wed May 18 22:40:35 2022 - graceful shutdown triggered... May 18 22:40:35.024856 dv-cinder-838009-6-iscsi devstack@n-api.service[109892]: Gracefully killing worker 2 (pid: 109892)... May 18 22:40:35.024450 dv-cinder-838009-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 18 22:40:35.025710 dv-cinder-838009-6-iscsi devstack@n-api.service[109891]: Gracefully killing worker 1 (pid: 109891)... May 18 22:40:36.025517 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: worker 1 buried after 1 seconds May 18 22:40:36.025517 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: worker 2 buried after 1 seconds May 18 22:40:36.025517 dv-cinder-838009-6-iscsi devstack@n-api.service[109890]: goodbye to uWSGI. May 18 22:40:36.027005 dv-cinder-838009-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 18 22:40:36.027566 dv-cinder-838009-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 18 22:40:36.030352 dv-cinder-838009-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 22:40:36.050867 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 22:40:36 2022] *** May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: nodename: dv-cinder-838009-6-iscsi May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: machine: x86_64 May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: clock source: unix May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: pcre jit disabled May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: detected number of CPU cores: 4 May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: current working directory: / May 18 22:40:36.068520 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: detected binary path: /usr/bin/uwsgi-core May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: your processes number limit is 47680 May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: your memory page size is 4096 bytes May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: detected max file descriptor number: 2048 May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: lock engine: pthread robust mutexes May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: thunder lock: enabled May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 22:40:36.069328 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 22:40:36.117100 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: Python main interpreter initialized at 0x555d3af559c0 May 18 22:40:36.117100 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: python threads support enabled May 18 22:40:36.117100 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: your server socket listen backlog is limited to 100 connections May 18 22:40:36.117100 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: your mercy for graceful operations on workers is 90 seconds May 18 22:40:36.117585 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: mapped 403077 bytes (393 KB) for 2 cores May 18 22:40:36.117585 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: *** Operational MODE: preforking *** May 18 22:40:36.117800 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: *** uWSGI is running in multiple interpreter mode *** May 18 22:40:36.117800 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: spawned uWSGI master process (pid: 124344) May 18 22:40:36.118051 dv-cinder-838009-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 22:40:36.118759 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: spawned uWSGI worker 1 (pid: 124366, cores: 1) May 18 22:40:36.119255 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: spawned uWSGI worker 2 (pid: 124367, cores: 1) May 18 22:40:36.119459 dv-cinder-838009-6-iscsi devstack@n-api.service[124344]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 22:40:37.334330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 22:40:37.362538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 22:40:38.130187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:40:38.130187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: from cryptography.utils import int_from_bytes May 18 22:40:38.130512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:40:38.130512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: from cryptography.utils import int_from_bytes May 18 22:40:38.170951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:40:38.170951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: from cryptography.utils import int_from_bytes May 18 22:40:38.171277 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 22:40:38.171277 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: from cryptography.utils import int_from_bytes May 18 22:40:40.561525 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 22:40:40.562331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 22:40:40.562331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 22:40:40.562706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 22:40:40.562960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 22:40:40.563348 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.563672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.563991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.564307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.564632 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.564939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.565255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.565572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.565896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.566195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.566506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.566829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-6-iscsi {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.567148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.567455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.567765 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.568084 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.568384 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.568702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.569003 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.569501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.570903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.570903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.570903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.571274 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.571504 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.571812 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.572113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.572432 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.572735 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.573053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.573462 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-6-iscsi {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.573778 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.574097 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.574423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.574826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.575154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.575432 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.576342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.576685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.576977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.578419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.578419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.578419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.578419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.578783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.578864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.580887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.581442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.581442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.581687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.581927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.582267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.582576 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.582879 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.583340 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.583651 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.583962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.584266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.584569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.584871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.585171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.585489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.585802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.586148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.586454 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.586772 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.587166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.587416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.587720 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.588056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.588370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.588673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.588988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.589304 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.589606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.589909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.590239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.590555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.590884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.591252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.592037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.592342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.592741 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.593063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.593369 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.593673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.593986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.594303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.594607 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.594912 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.595213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.595515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.595818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.596118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.596419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.596718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.597018 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.597333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.597647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.597949 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.598276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.598575 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.598876 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.599193 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.599494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.599796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.600112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.600412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.600712 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.601025 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.601326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.601627 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.601941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.602263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.602579 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.602881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.603217 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.603471 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.603774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.604075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.604370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.604670 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.604967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.605265 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.605558 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.605872 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.606215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.606519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.606900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.607358 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.607681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.608016 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.608346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.608686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.608997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.609326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.609652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.609965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.610301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.610612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.610936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.611244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.611552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.611860 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.612175 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.612492 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.612819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.613130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.613481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.613746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.614159 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.614394 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.614719 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.615038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.615358 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.615681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.616021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.616324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.616644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.616965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.617268 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.617573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.617882 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.618241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.618566 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.618877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.619191 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.619498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.619805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.620111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.620418 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.620724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.621059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.621371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.621682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.621990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.622324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.622679 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.622973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.623283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.623607 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.623875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.624221 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.624477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.624778 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.625094 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.625420 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.625725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.626087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.626392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.626699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.627003 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.627309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.627612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.627920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.628226 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.628526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.628846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.629150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.629451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.629771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.630095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.630399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.630709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.631018 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.632330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.632330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.632330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.632330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.632940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.632940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.633501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.633501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.633997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.634286 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.634693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.634693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.634979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.635260 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.635554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.635853 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.636153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.636456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.636754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.637054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.637355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.637654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.637952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.638931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.639216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.639522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.639826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.640127 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.640467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.640772 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.641116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.641451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.641768 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.642115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.642428 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.642742 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.643051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.643401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.643759 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.644148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.644297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.644559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.644901 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.645171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.645496 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.645805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.646145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.646454 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.646767 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.647101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.647428 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.647742 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.648122 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.648367 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.648680 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.648986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.649292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.649599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.649905 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.650243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.650550 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.654920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.655587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.656192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.656192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.656356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.656666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.656976 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.657277 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.657586 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.657888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.658227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.658495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 22:40:40.658932 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.659034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 22:40:40.659155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.659155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.659324 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 22:40:40.659411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.659639 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 22:40:40.659754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.659899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 22:40:40.660014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.660288 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.660394 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.660601 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.660692 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.660919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.661025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.661224 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.661323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.661523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.661616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.661825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.661932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.662147 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.662254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.662490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.662600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.662796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.662889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.663065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.663165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.663385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.663477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.663705 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.663804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-6-iscsi {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.664079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.664329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.664430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.664523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.664619 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.664714 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.664900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.664993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.665216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.665307 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.665524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.665617 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.665829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.665919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.666155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.666371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.666480 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.666683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.666776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.666999 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.667121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.667313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.667426 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.667634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.667725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.667937 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.668039 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.668240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.668342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.668538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.668632 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.668842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.668952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.669153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.669253 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.670422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.670519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.670760 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.670852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-6-iscsi {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.671126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.671269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.671430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.671529 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.671731 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.671845 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.672018 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.672159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.672477 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.672789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.673126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.673243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.673438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.673548 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.673759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.673883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.674212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.674330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.674429 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.674517 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.674790 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.674895 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.675079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.675172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.675360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.675453 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.675628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.675720 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.676074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.676260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.676351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.676648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.676953 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.677260 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.677481 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.677585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.677811 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.677916 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.678161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.678270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.678422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.678553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.678770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.679037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.679555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.679655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.679732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.679732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.679889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.679972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.680053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.680245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.680361 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.680502 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.680649 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.681103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.681241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.681399 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.681505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.681712 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.681805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.682043 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.682154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.682359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.682473 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.682669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.682768 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.682978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.683070 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.683286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.683386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.683386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.683825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.683909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.684075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.684167 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.684532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.684629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.684763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.684863 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.685537 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.685733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.686748 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.686920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.687073 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.687172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.687283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.687283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.687439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.687439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.687602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.687703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.687790 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.688029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.688132 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.688339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.688432 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.688647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.688786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.688970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.689064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.689297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.689398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.689572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.689739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.689873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.690048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.690198 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.690364 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.690505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.690691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.690793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.691031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.691124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.691339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.691439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.691594 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.691695 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.691970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.692111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.692270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.692362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.692574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.692665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.692875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.693028 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.693197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.693350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.693557 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.693694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.693825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.693923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.694139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.694314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.694453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.694597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.694774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.694883 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.695074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.695207 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.695382 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.695497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.695697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.695794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.696006 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.696111 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.696356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.696508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.696606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.696693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.696895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.697042 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.697195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.697294 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.697494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.697596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.697797 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.697896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.698119 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.698215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.698423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.698533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.698723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.698815 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.699024 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.699129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.699325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.699417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.699643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.699733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.699947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.700053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.700245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.700336 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.700604 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.700703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.700990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.701338 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.701461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.701646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.701782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.702015 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.707832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.707994 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.708095 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.708182 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.708273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.708358 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.708462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.708557 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.708650 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.708736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.708827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.708913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.709006 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.709132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.709224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.709309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.709884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.709986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.710161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.710265 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.710353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.710438 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.710522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.710606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.710703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.710789 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.710873 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.710964 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.711049 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.711146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.711242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.711327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.711419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.711504 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.711587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.711685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.711778 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 22:40:40.711871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.711962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712605 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712689 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712868 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.712951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713306 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713615 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.713968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714102 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714226 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714427 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.714972 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715062 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715706 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715790 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715874 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.715967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716456 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716720 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.716957 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.717943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718135 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718448 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718647 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.718944 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719042 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719661 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.719993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.720184 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.720275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.720502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.720594 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.720803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.720904 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.721122 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.721215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.721445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.721536 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.721765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.721870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.722116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.722232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.722426 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.722540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.722740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.722834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.723976 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724382 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724897 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.724998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.725219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.725374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.725548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.725643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.725862 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.725960 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.726200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.726336 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.726506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.726600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.726817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.726918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.727206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.727401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.727495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.727578 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.727732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.727823 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728046 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728357 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728509 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728757 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.728989 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.729091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.729301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.729437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.729608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.729749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.729930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730663 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.730975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.731193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.731292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.731495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.731595 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.732350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.732468 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.732659 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.732965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.733183 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.733278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.733527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.733631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.733853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.733946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.736506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.736659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.736776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.736975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737086 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737448 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.737970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738090 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738882 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.738967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739426 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.739936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740023 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740789 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740874 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.740997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741175 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741367 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741546 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.741893 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.742139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.742250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.742441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.742541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.742749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.742849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743049 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743443 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743650 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743742 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.743971 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744271 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744361 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.744988 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.745188 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.745287 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.745489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.745582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.745788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.745888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.746149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.746257 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.746464 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.746556 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.746786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.746918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.747131 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.747250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.747409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.748152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.748405 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.748801 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.748931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.749153 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.749247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.749482 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.749584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.749796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.749931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.750156 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.750257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.750451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.750552 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.750763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.750854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.751075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.751173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.751386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.751488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.751692 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.751791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752005 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752408 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.752937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.753176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.753279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.753507 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.753608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.753833 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.753948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764424 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764424 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.764964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765147 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765424 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765517 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765854 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.765952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766102 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766866 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.766950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767114 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.767909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768448 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768533 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768533 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768757 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.768998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769123 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769302 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769473 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769651 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.769964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770086 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770649 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.770969 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771062 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.771929 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772023 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772293 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772384 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772828 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.772912 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773097 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773189 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773281 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773821 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.773988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774338 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774424 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774674 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.774852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775635 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775831 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.775995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.776922 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777211 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777292 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777448 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777528 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777803 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777889 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.777962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778507 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778600 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.778733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.779329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.779413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.779579 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.779895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.780155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.780300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.780479 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.780573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.780799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.780909 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.781103 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.781204 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.781410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.781511 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.781713 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.781816 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.782039 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.782136 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.782352 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.782449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.782665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.782766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783105 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783324 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783417 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.783946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784344 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.784978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.785165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.785265 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.785472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.785613 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.785805 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.785904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.786141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.786247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.786452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.786671 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.786783 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787003 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787798 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.787961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.788090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.788292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.788669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.788669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.788883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.788970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789242 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789869 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.789969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790772 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.790979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791285 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791588 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.791982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.792192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.792291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.792496 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.792588 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.792797 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.792887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.793099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.793196 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.793415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.793536 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.793729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.793839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.794081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.794193 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.794399 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.794495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.794725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795167 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795348 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795481 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.795961 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.796109 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.796273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.796423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.796599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.796734 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.796912 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.797047 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.797216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.797374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.797634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.797731 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.797944 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.798050 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.798287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.798424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.798621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.798732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.798911 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799313 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799669 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799836 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.799940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.800142 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.800242 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.800443 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.800571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.800745 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.800846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801687 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.801991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.802134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.802315 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.802413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.802617 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.802709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.802920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803010 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.803938 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.804145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.804259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.804456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.804585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.804764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.804871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.805072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.805254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.805394 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.805488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.805943 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806685 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.806978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.807183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.807320 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.807483 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.807621 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.807783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.807879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808384 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.808984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.809154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.809282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.809438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.809580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.809682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.809878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.810591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.810750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811263 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811743 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.811999 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.812224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.812318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.812542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.812700 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.812856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.812951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.813171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.813267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.813487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.813580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.813802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.813895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.814137 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.814247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.814452 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.814545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.814761 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.814899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815066 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815477 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.815984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.816085 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.816293 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.816391 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.816604 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.816733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.816904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817210 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817308 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817641 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.817940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.818181 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.818276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.818490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.818634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.818819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.818913 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.819129 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.819221 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.819435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.819527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.819745 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.819881 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820147 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.820971 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.821067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.821297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.821404 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.821620 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.821713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.821927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.822057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.822270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.822379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.822592 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.822697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827281 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827400 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827705 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.827962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828289 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828474 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.828891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.829497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.829497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.829497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.829808 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.830160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.830477 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.830899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.831104 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.831432 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.831762 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.832120 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.832486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.832910 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.833240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.833556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.833883 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.834243 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.834557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.834868 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.835185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.835498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.835817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.836134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.836446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.836836 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.837092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.837387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.837698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.838032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.838358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.838668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.838998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.839315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.839643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.839969 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.840278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.840606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.840920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.841782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.842523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.842848 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.843205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.843520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.843856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.844197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.844537 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.844856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.845196 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.845526 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.845851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.846269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.846604 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.846921 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.847244 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.847545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.847856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.848170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.848479 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.848791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.849098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.849406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.849714 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.850062 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.850374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.850704 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.851013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.851321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.851631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.851938 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.852301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.852597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.852936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.853259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.853585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.853915 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.854253 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.854583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.854905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.855228 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.855548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.855866 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.856184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.856506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.857403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.858228 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.858562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.858890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.859217 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.859779 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.860115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.860441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.860763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.861083 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.861402 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.861719 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.862055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.862375 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.862693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.863009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.863343 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.863672 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.864003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.864346 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.864669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.864990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.865311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.865630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.866327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.866645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.866964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.867283 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.867599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.867913 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.868225 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.868540 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.868858 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.869173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.869484 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.869799 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.870138 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.870467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.870804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.871127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.871444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.871760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.872078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.872729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.873489 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.873831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.874190 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.874525 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.874851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.875173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.875508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.875820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.876131 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.876447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.876765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.877072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.877399 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.877713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.878446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.878446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.878691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.879195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.879547 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.879866 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.880195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.880524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.880843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.881153 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.881483 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.881793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.882134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.882458 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.882772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.883080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.883386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.883702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.884009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.884315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.884625 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.884922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Registered counter for database nova_api May 18 22:40:40.885032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.885246 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.885556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.885862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.886192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.886509 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.886812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.887119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.887426 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.887732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.888122 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.888900 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.889231 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.889532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.889847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.890181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.890497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.890856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.891184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.891565 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.891804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.892126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.892442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.892769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.893082 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.893395 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.893743 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.894084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.894626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.894964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.895286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.895626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.895962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.896271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.896586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.896894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.897220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.897532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.897843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.898178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.898491 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.898800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.899111 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.899420 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.899729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.900039 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.900348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.900795 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.901150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.901266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.902145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.902145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.902372 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.902564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.902885 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.903202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.903516 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.904790 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.905191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.905518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.905825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:40.905943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.906191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.906506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.906949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.907270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.907593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.907918 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.908236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.908564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.908893 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.909207 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.909528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.909842 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.910200 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.910549 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.910963 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.911213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.911525 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.911833 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.912141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.912454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.912775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.913090 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.913197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:40.913398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.913703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.914031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.914342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.914653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.914961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.915268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.915579 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.915884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.916189 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.916497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.916804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.917110 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.917416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.917725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.918056 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.918365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.918669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.918975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.919992 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.920703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.921058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.921381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.921718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.922060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.922394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.922717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.923049 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.923379 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.923701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.924016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.924352 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.924668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.924982 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.925296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.925609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.925919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.926255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.926588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.926918 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.927232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.927564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.927884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.928208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.928529 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.928843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.929175 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.929491 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.929804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.930144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.930459 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.931030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.931354 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.931672 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.932002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.932331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.932645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.932975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.933306 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.933657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.933972 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.934345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.934678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.935021 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.935849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.936171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 22:40:40.936427 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124366) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 22:40:40.969487 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.context [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a5ec003-2fee-4752-99af-302cbb09e086(cell1) {{(pid=124367) load_cells /opt/stack/nova/nova/context.py:464}} May 18 22:40:40.973848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:40:40.975422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:40:40.976200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:40:40.978149 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:40:40.980112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Registered counter for database nova_cell0 May 18 22:40:40.984892 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Registered counter for database nova_cell1 May 18 22:40:40.991988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:40.993653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:41.000537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.001819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO dbcounter [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Registered counter for database nova_api May 18 22:40:41.001982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.025410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_db.sqlalchemy.engines [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:41.034972 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writer thread running {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.095437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.context [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0a5ec003-2fee-4752-99af-302cbb09e086(cell1) {{(pid=124366) load_cells /opt/stack/nova/nova/context.py:464}} May 18 22:40:41.099797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:40:41.101378 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:40:41.102196 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:40:41.104151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:40:41.106160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO dbcounter [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Registered counter for database nova_cell0 May 18 22:40:41.111318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO dbcounter [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Registered counter for database nova_cell1 May 18 22:40:41.119043 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_db.sqlalchemy.engines [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:41.119807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_db.sqlalchemy.engines [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:41.126269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writer thread running {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.128335 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writer thread running {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.149597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO dbcounter [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Registered counter for database nova_cell0 May 18 22:40:41.156916 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_db.sqlalchemy.engines [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:41.161362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writer thread running {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.282346 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO dbcounter [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Registered counter for database nova_cell0 May 18 22:40:41.289081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_db.sqlalchemy.engines [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124366) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 22:40:41.293728 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writer thread running {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 22:40:41.483118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:40:41.491022 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:40:41.624362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: WARNING keystonemiddleware.auth_token [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:40:41.631839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: WARNING keystonemiddleware.auth_token [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:40:41.835159 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:40:41.841878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: WARNING keystonemiddleware.auth_token [None req-18c147dc-7524-43b8-960f-03beb46e3979 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:40:41.847157 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d3af559c0 pid: 124367 (default app) May 18 22:40:41.974187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: WARNING keystonemiddleware.auth_token [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 22:40:41.980384 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: WARNING keystonemiddleware.auth_token [None req-d32b557e-939c-494b-b63b-1dfe8ff86458 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 22:40:41.985649 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d3af559c0 pid: 124366 (default app) May 18 22:41:24.519105 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.520588 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.521754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.522819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.742269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.743093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.746786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:24.747725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:25.767460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-86638de2-d1be-467c-abb0-d75e347f9b71 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Action: 'create', calling method: .version_select at 0x7f6cdaed34c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-146374823"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:25.949439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ac6c4ee5-e58d-4c42-82f9-d73f737e6937 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Action: 'create', calling method: .version_select at 0x7f6cdaed7700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-250741191", "metadata": {"Type": "work"}}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:28.102068 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-86638de2-d1be-467c-abb0-d75e347f9b71 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.593785 May 18 22:41:28.102706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1154 bytes} [Wed May 18 22:41:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 18 22:41:28.452753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1219677469", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "networks": [{"uuid": "a29a1140-62f3-4e10-a262-5a95efec486d"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:28.452753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] validate_networks() for [('a29a1140-62f3-4e10-a262-5a95efec486d', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:41:28.764501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ac6c4ee5-e58d-4c42-82f9-d73f737e6937 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.044111 May 18 22:41:28.772457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 1/2] 10.222.0.70 () {60 vars in 1155 bytes} [Wed May 18 22:41:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4054 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 18 22:41:28.783373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a62cc881-bf9f-4909-9d49-4aaa5ba684a9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdada1550>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:28.992072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a62cc881-bf9f-4909-9d49-4aaa5ba684a9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485" status: 200 len: 345 microversion: 2.1 time: 0.217405 May 18 22:41:28.993023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:28 2022] GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:28.998070 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a21be66f-e4ad-46cd-8238-c1e52da5ab98 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cdada1ca0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:29.124541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a21be66f-e4ad-46cd-8238-c1e52da5ab98 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.130299 May 18 22:41:29.126099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:28 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:29.132360 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c8b48daf-9571-44f5-92d0-ece06c286285 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Action: 'create', calling method: .version_select at 0x7f6cdada1d30>, body: {"snapshot": {"volume_id": "5646d687-e25c-4ad3-b5b2-7845cfad7485", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-772557577"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:29.829192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c8b48daf-9571-44f5-92d0-ece06c286285 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.701557 May 18 22:41:29.834656 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 4/5] 10.222.0.70 () {60 vars in 1161 bytes} [Wed May 18 22:41:29 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:29.839506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-82da5a98-8d2d-4f28-bf57-1180ae888667 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cdadad280>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:29.974560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-82da5a98-8d2d-4f28-bf57-1180ae888667 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/c5554a64-75fe-4d48-98a8-35b95c7aa288" status: 200 len: 351 microversion: 2.1 time: 0.138715 May 18 22:41:29.981061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 5/6] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:29 2022] GET /compute/v2.1/os-volumes/c5554a64-75fe-4d48-98a8-35b95c7aa288 => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:29.986783 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3a73488f-b380-489d-811a-67b899805668 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdadad9d0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:30.146263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:41:30.146788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:41:30.147545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:41:30.147984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:41:30.148399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:41:30.178065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:30.178584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:30.182748 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:30.183272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:30.291008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Getting quotas for project f60b6521267447fe8b4c12f701a40144. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:41:30.300316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Getting quotas for user 270785984bc645ec899aeb22a8f9054f and project f60b6521267447fe8b4c12f701a40144. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:41:30.315380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:41:30.318514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:41:30.556954 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d9aba0c1-0f73-43ae-80ef-51b0a60c20c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.452854 May 18 22:41:30.557849 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 2/7] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:41:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:41:30.578328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5f9461aa-f0c5-4ea2-8576-4850339ce4f9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9c44040>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:30.656454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3a73488f-b380-489d-811a-67b899805668 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.674113 May 18 22:41:30.657129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 6/8] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:29 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:30.681862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e14dbfc1-ed83-46cc-922f-19701b9ecf57 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:30.691547 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e14dbfc1-ed83-46cc-922f-19701b9ecf57 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:30.780987 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5f9461aa-f0c5-4ea2-8576-4850339ce4f9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 353 microversion: 2.1 time: 0.219343 May 18 22:41:30.781993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 3/9] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:30 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 353 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:30.788302 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-35609154-d1c0-4f0e-95f9-b24d5b5d814b tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9c44700>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:30.974938 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-35609154-d1c0-4f0e-95f9-b24d5b5d814b tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.191085 May 18 22:41:30.975527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 4/10] 10.222.0.70 () {58 vars in 1139 bytes} [Wed May 18 22:41:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:31.002637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cdbd349e-386a-435d-9172-99c50835c5c6 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9c44670>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:31.126681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cdbd349e-386a-435d-9172-99c50835c5c6 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 353 microversion: 2.1 time: 0.149224 May 18 22:41:31.127522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 5/11] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:30 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:31.134286 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-be2de724-286b-4e5f-a67b-cb96b4dd3713 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9c44d30>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:31.258832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-be2de724-286b-4e5f-a67b-cb96b4dd3713 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.129852 May 18 22:41:31.259737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:31 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:31.261086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e14dbfc1-ed83-46cc-922f-19701b9ecf57 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:31.273597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-485efbad-e715-4040-b07e-b9257df0ecce tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9c504c0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:31.282416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e14dbfc1-ed83-46cc-922f-19701b9ecf57 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1215 microversion: 2.1 time: 0.612643 May 18 22:41:31.283608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:30 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1215 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:31.631308 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-485efbad-e715-4040-b07e-b9257df0ecce tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 202 len: 0 microversion: 2.1 time: 0.370139 May 18 22:41:31.634727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 7/14] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:41:31 2022] DELETE /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:41:31.641115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7ef7f376-5cee-4ba5-b4ac-dd63a4e78565 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cdad73f70>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:31.771536 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7ef7f376-5cee-4ba5-b4ac-dd63a4e78565 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.135276 May 18 22:41:31.776629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:31 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:32.200693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1944213910", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:32.273781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-baecd69c-4a29-4a67-9b8b-479f8687fffb tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdad781f0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:32.284655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] validate_networks() for [('11499028-97ea-4e44-af1f-548128f3e70d', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:41:32.325981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-baecd69c-4a29-4a67-9b8b-479f8687fffb tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.058601 May 18 22:41:32.329670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 9/16] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:32 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:32.335863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ea26a062-5b8e-4dfc-9af9-d4b191418789 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:32.336624 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ea26a062-5b8e-4dfc-9af9-d4b191418789 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:32.414311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ea26a062-5b8e-4dfc-9af9-d4b191418789 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:32.430023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ea26a062-5b8e-4dfc-9af9-d4b191418789 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1215 microversion: 2.1 time: 0.098740 May 18 22:41:32.440235 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 10/17] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:32 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:32.784404 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-869a8fc8-cce8-4bd8-81de-c53fb3a303ac tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cdad784c0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:32.850570 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-869a8fc8-cce8-4bd8-81de-c53fb3a303ac tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.070302 May 18 22:41:32.851571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 11/18] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:32 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:32.863258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:41:32.863851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:41:32.864492 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:41:32.864910 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:41:32.865324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:41:32.884953 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:32.885666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:32.888099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:32.890556 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:32.938690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:41:32.948890 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for user be51e8b84bb7471bb17409b331e599eb and project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:41:32.973403 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:41:32.975810 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:41:33.125918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a4f5d877-2644-4602-b2aa-58052ae6f69a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.024174 May 18 22:41:33.127179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 8/19] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:41:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:41:33.137118 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a656e825-8fcb-40a7-b620-dfa757013e82 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:33.137440 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a656e825-8fcb-40a7-b620-dfa757013e82 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:33.227393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a656e825-8fcb-40a7-b620-dfa757013e82 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:33.249553 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a656e825-8fcb-40a7-b620-dfa757013e82 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1222 microversion: 2.1 time: 0.115076 May 18 22:41:33.262789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 12/20] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:33 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:33.321540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1295705061", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:33.339971 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9782cfd3-8224-4df8-abaa-d25a97a607c3 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdaf8c4c0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:33.391492 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] validate_networks() for [('11499028-97ea-4e44-af1f-548128f3e70d', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:41:33.406586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9782cfd3-8224-4df8-abaa-d25a97a607c3 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.070527 May 18 22:41:33.407162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 13/21] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:33 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:33.448227 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:33.448920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:33.458328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:33.461993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:33.462822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:33.463257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:33.781086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:33.797390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1072c473-9c74-4899-8e24-3e11ea67d19e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1219 microversion: 2.1 time: 0.353349 May 18 22:41:33.800018 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 14/22] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:33 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1219 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:33.867317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-614a09fa-a94a-486e-bc22-92d0a3a738f4 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cdacf5ca0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:33.947126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:41:33.947869 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:41:33.948486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:41:33.948919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:41:33.949322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:41:33.949667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-614a09fa-a94a-486e-bc22-92d0a3a738f4 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.090079 May 18 22:41:33.950314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 15/23] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:33 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:33.958184 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:33.958631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:33.959614 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:33.960730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:33.977979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:41:33.982058 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for user be51e8b84bb7471bb17409b331e599eb and project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:41:33.995457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:41:34.009996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:41:34.302289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e6dfb888-7265-4cfb-9255-81d767cd5fe4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.984038 May 18 22:41:34.333646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 9/24] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:41:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:41:34.341029 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4e02bdd8-0b47-45ba-b568-3b1f20072c1f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:34.341029 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4e02bdd8-0b47-45ba-b568-3b1f20072c1f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:34.419403 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d26bb804-42a4-4b23-93b5-f664a8903e14 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9c50f70>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:34.450690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4e02bdd8-0b47-45ba-b568-3b1f20072c1f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:34.457319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4e02bdd8-0b47-45ba-b568-3b1f20072c1f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1222 microversion: 2.1 time: 0.150206 May 18 22:41:34.457890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 16/25] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:34 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:34.473448 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d26bb804-42a4-4b23-93b5-f664a8903e14 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.058848 May 18 22:41:34.478745 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 10/26] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:34 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:34.816847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:34.817462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:34.824968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:34.825334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:34.826187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:34.836058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:34.962455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-96fb8feb-fb53-4b67-80ed-69608a393465 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9c44790>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:35.073828 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-96fb8feb-fb53-4b67-80ed-69608a393465 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.115480 May 18 22:41:35.074682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 11/27] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:34 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:35.093400 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:35.101601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5cd0b80e-bfb3-46da-91a1-a0f4d57084fc tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1219 microversion: 2.1 time: 0.288531 May 18 22:41:35.102223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 17/28] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:34 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1219 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:35.475461 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:35.476168 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:35.489254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b6ba500a-ee70-4a80-9338-82c376aa6991 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdac95280>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:35.545982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:35.546664 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:35.547931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:35.552805 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b6ba500a-ee70-4a80-9338-82c376aa6991 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.066576 May 18 22:41:35.553469 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 18/29] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:35 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:35.554110 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:35.736563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:35.780573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-465cd950-c390-4a53-bfe6-be3b7e914caa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1226 microversion: 2.1 time: 0.307366 May 18 22:41:35.782928 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 12/30] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:35 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1226 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:35.908665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8126be45-fc7a-4a0c-8e63-2cbe872146fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: .version_select at 0x7f6cdac958b0>, body: {"keypair": {"name": "tempest-keypair-1354280919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJR7oJej3It2UrQ0atQU3qdRDYWsRszNAEHjhrsTiKPZQcRIpmoULq8JA//RkzWE9PNqOKPRDcKmxXmWltxk/qZ71inQjS4UBaDMWQ3f32a8GLlYss4IE4vHOnD8C2eitg=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:35.986475 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-8126be45-fc7a-4a0c-8e63-2cbe872146fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:41:35.994724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-8126be45-fc7a-4a0c-8e63-2cbe872146fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:41:36.087234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d3dc2d26-aa78-4f2e-bb85-2a0ed168c3e4 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9bcc700>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:36.128954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8126be45-fc7a-4a0c-8e63-2cbe872146fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314803 May 18 22:41:36.130187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 19/31] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:41:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:36.135364 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:36.136401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:36.145701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:36.146402 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:36.148388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:36.151625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d3dc2d26-aa78-4f2e-bb85-2a0ed168c3e4 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.068753 May 18 22:41:36.152255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 13/32] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:36 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:36.152678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:36.269745 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:36.292032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-56b40715-1364-45b4-9f7e-317d779a6292 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1219 microversion: 2.1 time: 0.150720 May 18 22:41:36.298048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 20/33] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:36 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:36.565681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d06e58e3-3a50-4046-833b-c90bb4363bbe tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9bd7c10>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:36.642331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d06e58e3-3a50-4046-833b-c90bb4363bbe tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.081218 May 18 22:41:36.646495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 14/34] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:36 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:36.808306 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:36.809207 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:36.816923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:36.817383 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:36.818232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:36.818747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:36.908012 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:36.916086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c58d8275-679e-44d6-9002-73fdaa29c02a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1274 microversion: 2.1 time: 0.121358 May 18 22:41:36.917077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 21/35] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:36 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:37.164245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-071b2dad-fbd6-4529-afee-a351c771a5fd tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9be9280>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:37.216355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-071b2dad-fbd6-4529-afee-a351c771a5fd tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.055851 May 18 22:41:37.217340 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 15/36] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:37 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:37.315250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:37.316113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:37.322450 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:37.322906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:37.323695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:37.324129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:37.402235 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:37.413099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7cd9a775-e171-4dc0-b0d6-9224d73a9f09 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1267 microversion: 2.1 time: 0.101597 May 18 22:41:37.414145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 22/37] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:37 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:37.653356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1980bc3d-612f-44f1-9538-b32243c34b1c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdacb1b80>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:37.689366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1980bc3d-612f-44f1-9538-b32243c34b1c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 287 microversion: 2.1 time: 0.039685 May 18 22:41:37.690036 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 16/38] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:37 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:37.699980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c3f477a6-0869-4205-aef3-814643cb0d11 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cda3e2700>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:37.831726 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c3f477a6-0869-4205-aef3-814643cb0d11 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 202 len: 0 microversion: 2.1 time: 0.135304 May 18 22:41:37.833233 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 23/39] 10.222.0.70 () {58 vars in 1253 bytes} [Wed May 18 22:41:37 2022] DELETE /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:41:37.842026 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0fca2c74-3e55-4fc9-a33b-f7293aa8d809 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9c444c0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:37.871511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0fca2c74-3e55-4fc9-a33b-f7293aa8d809 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.033817 May 18 22:41:37.872094 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 17/40] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:37 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:37.937250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:37.937962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:37.946962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:37.947420 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:37.948197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:37.948642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:38.013857 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:38.021205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a8dc82db-bdde-4112-bbdc-4cc76f38cdd7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1274 microversion: 2.1 time: 0.088851 May 18 22:41:38.021776 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 24/41] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:37 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:38.228935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e050dec-c1f7-4c4d-ad54-8b7b07d098bf tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9be94c0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:38.277785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e050dec-c1f7-4c4d-ad54-8b7b07d098bf tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.052917 May 18 22:41:38.278410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 18/42] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:38 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:38.438046 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:38.438046 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:38.438325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:38.438532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:38.439304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:38.439748 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:38.541753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:38.550036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a1e523d3-bd30-4175-84e6-2ce9ef100e93 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1267 microversion: 2.1 time: 0.123209 May 18 22:41:38.550703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 25/43] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:38 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:38.853317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1076854986", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbd3cb94-6b06-443d-a376-6f705f586753"}], "security_groups": [{"name": "tempest-securitygroup--2057584601"}], "key_name": "tempest-keypair-1354280919", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:38.883605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-df3b5213-c83c-4dc1-ab26-f7f68f2a22f4 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cda3f5280>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:38.914144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-df3b5213-c83c-4dc1-ab26-f7f68f2a22f4 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.034014 May 18 22:41:38.914746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 26/44] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:38 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:38.987967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] validate_networks() for [('fbd3cb94-6b06-443d-a376-6f705f586753', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:41:39.038263 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:39.038886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:39.045957 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:39.046440 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:39.047222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:39.047665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:39.130840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:39.139237 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-583d593f-882f-4df5-a037-0dd8ce0ee45b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1274 microversion: 2.1 time: 0.104621 May 18 22:41:39.139906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 27/45] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:39 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:39.290932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-be2844f5-fca2-49f8-bb08-77efbfa00f1b tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cda3e2160>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:39.343341 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-be2844f5-fca2-49f8-bb08-77efbfa00f1b tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.056101 May 18 22:41:39.344018 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 28/46] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:39 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:39.487322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:41:39.487834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:41:39.488312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:41:39.489442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:41:39.489872 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:41:39.499050 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:39.499500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:39.500312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:39.500746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:39.518464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:41:39.522216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:41:39.534618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:41:39.536775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:41:39.567461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:39.568082 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:39.577154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:39.578015 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:39.578953 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:39.579426 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:39.657439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:39.680643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ddeaa059-2828-40fa-b43f-4f8b6b17d983 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1267 microversion: 2.1 time: 0.110089 May 18 22:41:39.680643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 29/47] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:39 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:39.683618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-204588d5-e7fa-4c3c-805b-4774cd233231 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.835888 May 18 22:41:39.688129 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 19/48] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:41:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:41:39.697139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-678ee072-c3f5-4c34-8f5a-2ffc198317d2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:39.697767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-678ee072-c3f5-4c34-8f5a-2ffc198317d2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:39.763182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-678ee072-c3f5-4c34-8f5a-2ffc198317d2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:39.771939 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-678ee072-c3f5-4c34-8f5a-2ffc198317d2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1242 microversion: 2.1 time: 0.078880 May 18 22:41:39.772550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 30/49] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:39 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:39.925920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d5102b6d-a29e-4209-a9c6-8502b4f6a1a4 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9be9040>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:39.958183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d5102b6d-a29e-4209-a9c6-8502b4f6a1a4 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.035940 May 18 22:41:39.959092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 20/50] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:39 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:40.156076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:40.156684 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:40.162744 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:40.163193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:40.163991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:40.164418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:40.236890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:40.248587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d018bd4a-fdad-4773-a8b1-faaf3f26b27a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1274 microversion: 2.1 time: 0.096240 May 18 22:41:40.249183 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 31/51] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:40 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:40.354887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b4a14920-b53e-46fe-86c0-178180024a47 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cd9b894c0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:40.418854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b4a14920-b53e-46fe-86c0-178180024a47 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.067736 May 18 22:41:40.419441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 21/52] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:40 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:40.691055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:40.692257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:40.698240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:40.698690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:40.699463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:40.700086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:40.776381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:40.785566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-51006c05-ba4d-4a4b-a100-0051cad4d3db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1267 microversion: 2.1 time: 0.098462 May 18 22:41:40.786881 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 32/53] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:40 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:40.790423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:40.790902 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:40.797857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:40.798891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:40.800084 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:40.800751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:40.893121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:40.900809 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3b038b2c-84d2-4d63-993d-b3ef6ac0a7b3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1246 microversion: 2.1 time: 0.114107 May 18 22:41:40.902031 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 22/54] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:40 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:40.972013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8838ea56-e204-4077-8ce0-8a251ccd1f72 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdac108b0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:41.006665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8838ea56-e204-4077-8ce0-8a251ccd1f72 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 200 len: 286 microversion: 2.1 time: 0.040163 May 18 22:41:41.007323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 33/55] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:40 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:41.265888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:41.270251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:41.289751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:41.293276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:41.300919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:41.301422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:41.434474 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fc3fd723-b5e0-4de6-b851-2310bb2fb3a8 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cda3e2c10>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:41.481532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:41.493729 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-47d12d52-0f06-4005-b02c-d4fc84844135 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1274 microversion: 2.1 time: 0.232538 May 18 22:41:41.507204 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 23/56] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:41 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:41.588063 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fc3fd723-b5e0-4de6-b851-2310bb2fb3a8 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.159542 May 18 22:41:41.588650 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 34/57] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:41 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:41.803255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:41.804374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:41.824349 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:41.824826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:41.825617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:41.830208 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:41.920205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:41.921356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:41.934698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:41.938635 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:41.939712 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:41.941714 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:42.063784 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:42.072328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a323b60-67c0-4b20-97e9-e5c0a499ea0f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1273 microversion: 2.1 time: 0.272894 May 18 22:41:42.073310 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 24/58] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:41 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:42.079134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0afbf345-26df-454b-8129-42a734f0104c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9bbc1f0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:42.125781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-0afbf345-26df-454b-8129-42a734f0104c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] HTTP exception thrown: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. May 18 22:41:42.130316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0afbf345-26df-454b-8129-42a734f0104c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Request method failure captured: May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 HTTP/1.1 May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYU44x0okmwPqMpwjAe05OBqXohe7y1LGQ38yO7O7Yx6t3U1l3HOic8zyTd53UKw_oWE18S2QfevePxoI0oSDHgPVVlOk5EVQuq62TrQ7_Hj4QcNYvuCpssY5i5Uo56Ro6UHoYDmF1quHDm_A0IiFxtxh8jQCQCSJgF4qOaXlC8th0 May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:42.141818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3469a2ead69c44788bf29197caaedd4e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3469a2ead69c44788bf29197caaedd4e"}]}] May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: eadfa254989a4950a50c1dff5abc874e May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'ca15dc24-bdea-4bf1-8ea3-43db20c877d5'} May 18 22:41:42.143213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. (HTTP 404) (Request-ID: req-748e8834-8d57-4910-8969-c8020eaf0e0f) May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.143904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:42.144950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 18 22:41:42.145955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0afbf345-26df-454b-8129-42a734f0104c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Returning 404 to user: Snapshot ca15dc24-bdea-4bf1-8ea3-43db20c877d5 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0afbf345-26df-454b-8129-42a734f0104c tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5" status: 404 len: 111 microversion: 2.1 time: 0.063169 May 18 22:41:42.147535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 25/59] 10.222.0.70 () {58 vars in 1250 bytes} [Wed May 18 22:41:42 2022] GET /compute/v2.1/os-snapshots/ca15dc24-bdea-4bf1-8ea3-43db20c877d5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:41:42.149928 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ea1843ea-906f-405e-84e5-8e860a692a2a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1294 microversion: 2.1 time: 0.235125 May 18 22:41:42.151250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 35/60] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:41 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1294 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:42.151507 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-366ff854-4ae7-4aa6-a4ae-e7ce031a7ad0 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdb700a60>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:42.384237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-366ff854-4ae7-4aa6-a4ae-e7ce031a7ad0 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485" status: 202 len: 0 microversion: 2.1 time: 0.239956 May 18 22:41:42.388091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 26/61] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:41:42 2022] DELETE /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:41:42.402631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-61a73afe-aab0-4c75-a8be-d8e35b182a3d tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdac109d0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:42.513005 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:42.514759 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:42.529150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:42.530502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:42.531454 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:42.531964 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:42.532820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-61a73afe-aab0-4c75-a8be-d8e35b182a3d tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485" status: 200 len: 344 microversion: 2.1 time: 0.142001 May 18 22:41:42.537940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 36/62] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:42 2022] GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:42.604172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4070a0c7-e36c-45a9-ad34-e826d47b9be9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cda3f5b80>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:42.627922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:42.653359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9e92873b-b4c0-46af-96ea-8b80d1f51712 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1280 microversion: 2.1 time: 0.144431 May 18 22:41:42.658774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 27/63] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:42 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:42.713531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4070a0c7-e36c-45a9-ad34-e826d47b9be9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 200 len: 352 microversion: 2.1 time: 0.116756 May 18 22:41:42.715483 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 37/64] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:42 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:42.992673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b9b405f4-afd3-47ff-a599-fa5af77d084b tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cd9b37b80>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.090121 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.091003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:43.125900 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:43.132374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b9b405f4-afd3-47ff-a599-fa5af77d084b tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/d8f86b33-cc15-4b51-99b6-a3364aef4f30" status: 200 len: 350 microversion: 2.1 time: 0.144733 May 18 22:41:43.133166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 28/65] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:42 2022] GET /compute/v2.1/os-volumes/d8f86b33-cc15-4b51-99b6-a3364aef4f30 => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:43.137000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:43.137949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:43.138932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:43.167215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.167991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:43.178078 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:43.187132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:43.188148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:43.188723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:43.372344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:43.384053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f10afd05-6102-41ef-b8c2-5b0c51f4075e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.220478 May 18 22:41:43.384653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 29/66] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:43 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:43.453417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:43.477171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b4d91a9c-29c8-4274-931c-505157707e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.390878 May 18 22:41:43.493802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 38/67] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:43 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:43.545275 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-489dcb0b-b39c-4651-9c4c-87b89d9c9812 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9abe550>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.677323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.677943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:43.684890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:43.686066 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:43.686857 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:43.687296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:43.759590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:43.768060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1efd90d2-3a69-49eb-9e16-2606f8c6ca27 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1280 microversion: 2.1 time: 0.094643 May 18 22:41:43.768964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 39/68] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:43 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:43.773875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ebf3cb17-4f9d-4bd0-a44a-9d6f36548bf9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Calling method '.version_select at 0x7f6cda3f5550>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.873918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-489dcb0b-b39c-4651-9c4c-87b89d9c9812 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] HTTP exception thrown: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-489dcb0b-b39c-4651-9c4c-87b89d9c9812 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Request method failure captured: May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 HTTP/1.1 May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYU44x0okmwPqMpwjAe05OBqXohe7y1LGQ38yO7O7Yx6t3U1l3HOic8zyTd53UKw_oWE18S2QfevePxoI0oSDHgPVVlOk5EVQuq62TrQ7_Hj4QcNYvuCpssY5i5Uo56Ro6UHoYDmF1quHDm_A0IiFxtxh8jQCQCSJgF4qOaXlC8th0 May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:43.878138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3469a2ead69c44788bf29197caaedd4e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3469a2ead69c44788bf29197caaedd4e"}]}] May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: eadfa254989a4950a50c1dff5abc874e May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '5646d687-e25c-4ad3-b5b2-7845cfad7485'} May 18 22:41:43.879239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. (HTTP 404) (Request-ID: req-28dc1396-bcc7-40c7-92a4-5537beaca01f) May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:43.880054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:43.881628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 22:41:43.882682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-489dcb0b-b39c-4651-9c4c-87b89d9c9812 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Returning 404 to user: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-489dcb0b-b39c-4651-9c4c-87b89d9c9812 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485" status: 404 len: 109 microversion: 2.1 time: 0.338966 May 18 22:41:43.884505 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 30/69] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:43 2022] GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 => generated 109 bytes in 341 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:41:43.892091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e21545b9-0851-4090-b045-051dd92ab9a1 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cd9b374c0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:43.910729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-ebf3cb17-4f9d-4bd0-a44a-9d6f36548bf9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] HTTP exception thrown: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ebf3cb17-4f9d-4bd0-a44a-9d6f36548bf9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Request method failure captured: May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 HTTP/1.1 May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYUS0Hbwkb2884j4YNJtmxJERVSS-vPMW0_yhQnhMqXA6ltqBTMTg8oZhMWRPlE7qhDqIjokJVzAjaBVN0mNV79EoWmTfkoqYhv4U_d9L-OPZ45OZVkFv-0H823jTubV8GXqB-3iHJJEqrcqimHhXllR1oX09wqfJqPiC16nMlZx7w May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: baa1d5dbae03406b9dc8f5932ec1bcbc May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-VolumesGetTestJSON-1578883961 May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:41:43.915417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_baa1d5dbae03406b9dc8f5932ec1bcbc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/baa1d5dbae03406b9dc8f5932ec1bcbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/baa1d5dbae03406b9dc8f5932ec1bcbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/baa1d5dbae03406b9dc8f5932ec1bcbc"}]}] May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-VolumesGetTestJSON-1578883961 May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: baa1d5dbae03406b9dc8f5932ec1bcbc May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-VolumesGetTestJSON-1578883961 May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-VolumesGetTestJSON-1578883961-project May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 2a49cfb501a24446ba4b1717bb1cafbc May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-VolumesGetTestJSON-1578883961-project May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '4bb705f9-0b47-44af-b803-3fc6f47bb602'} May 18 22:41:43.916508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. (HTTP 404) (Request-ID: req-4f2337f4-2927-4acf-9ff7-aeca18366a4a) May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:43.917206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:43.918793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 22:41:43.920013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ebf3cb17-4f9d-4bd0-a44a-9d6f36548bf9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] Returning 404 to user: Volume 4bb705f9-0b47-44af-b803-3fc6f47bb602 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ebf3cb17-4f9d-4bd0-a44a-9d6f36548bf9 tempest-VolumesGetTestJSON-1578883961 tempest-VolumesGetTestJSON-1578883961-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602" status: 404 len: 109 microversion: 2.1 time: 0.146856 May 18 22:41:43.923804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 40/70] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:43 2022] GET /compute/v2.1/os-volumes/4bb705f9-0b47-44af-b803-3fc6f47bb602 => generated 109 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:41:44.001595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-e21545b9-0851-4090-b045-051dd92ab9a1 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] HTTP exception thrown: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e21545b9-0851-4090-b045-051dd92ab9a1 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Request method failure captured: May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 HTTP/1.1 May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYU44x0okmwPqMpwjAe05OBqXohe7y1LGQ38yO7O7Yx6t3U1l3HOic8zyTd53UKw_oWE18S2QfevePxoI0oSDHgPVVlOk5EVQuq62TrQ7_Hj4QcNYvuCpssY5i5Uo56Ro6UHoYDmF1quHDm_A0IiFxtxh8jQCQCSJgF4qOaXlC8th0 May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:44.004940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3469a2ead69c44788bf29197caaedd4e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3469a2ead69c44788bf29197caaedd4e"}]}] May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: eadfa254989a4950a50c1dff5abc874e May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '5646d687-e25c-4ad3-b5b2-7845cfad7485'} May 18 22:41:44.006583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. (HTTP 404) (Request-ID: req-805af788-63a4-4af3-a85b-738a0baaa804) May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:44.007472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 22:41:44.008969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 22:41:44.010233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.011200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:44.014435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e21545b9-0851-4090-b045-051dd92ab9a1 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Returning 404 to user: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:44.015951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e21545b9-0851-4090-b045-051dd92ab9a1 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485" status: 404 len: 109 microversion: 2.1 time: 0.130115 May 18 22:41:44.019794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 31/71] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:41:43 2022] DELETE /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:41:44.027261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-97654612-0df5-4628-88c8-7aae46e9e2e9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Calling method '.version_select at 0x7f6cdada18b0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:44.061761 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-97654612-0df5-4628-88c8-7aae46e9e2e9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] HTTP exception thrown: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-97654612-0df5-4628-88c8-7aae46e9e2e9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Request method failure captured: May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 HTTP/1.1 May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYU44x0okmwPqMpwjAe05OBqXohe7y1LGQ38yO7O7Yx6t3U1l3HOic8zyTd53UKw_oWE18S2QfevePxoI0oSDHgPVVlOk5EVQuq62TrQ7_Hj4QcNYvuCpssY5i5Uo56Ro6UHoYDmF1quHDm_A0IiFxtxh8jQCQCSJgF4qOaXlC8th0 May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:41:44.063889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3469a2ead69c44788bf29197caaedd4e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3469a2ead69c44788bf29197caaedd4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3469a2ead69c44788bf29197caaedd4e"}]}] May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 3469a2ead69c44788bf29197caaedd4e May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110668628 May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: eadfa254989a4950a50c1dff5abc874e May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110668628-project May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '5646d687-e25c-4ad3-b5b2-7845cfad7485'} May 18 22:41:44.065313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. (HTTP 404) (Request-ID: req-362bff45-8efc-4d97-836d-ba5f0bc4ae8d) May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:44.066300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:44.067422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 22:41:44.068675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. May 18 22:41:44.069855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:44.071694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-97654612-0df5-4628-88c8-7aae46e9e2e9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] Returning 404 to user: Volume 5646d687-e25c-4ad3-b5b2-7845cfad7485 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:44.072693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-97654612-0df5-4628-88c8-7aae46e9e2e9 tempest-VolumesSnapshotsTestJSON-110668628 tempest-VolumesSnapshotsTestJSON-110668628-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485" status: 404 len: 109 microversion: 2.1 time: 0.051523 May 18 22:41:44.073493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 41/72] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:44 2022] GET /compute/v2.1/os-volumes/5646d687-e25c-4ad3-b5b2-7845cfad7485 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 22:41:44.403343 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:44.404921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:44.413374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:44.413839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:44.414832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:44.415278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:44.501827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:44.502478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:44.507831 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:44.509837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:44.510308 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:44.511407 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:44.512666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:44.523190 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-da215925-1e7c-4320-af44-15df3aadda1a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.123426 May 18 22:41:44.536878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 32/73] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:44 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:44.658107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:44.665369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-33b2d6ee-0de7-46a5-a9b8-36b19a1b215e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.168057 May 18 22:41:44.665924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 42/74] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:44 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:44.786177 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:44.788538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:44.797626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:44.798522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:44.799512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:44.800236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:44.972698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:44.984237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-189189d7-871c-4d30-ae77-d8c52fdcb3cc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.202659 May 18 22:41:44.985306 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 33/75] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:44 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:45.542962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:45.543956 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:45.551894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:45.554798 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:45.554798 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:45.554798 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:45.630715 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:45.647130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1178f8be-4cfb-4af3-9b80-ebbcb05808d7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.108656 May 18 22:41:45.647740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 43/76] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:45 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:45.699880 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:45.700586 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:45.718585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:45.719394 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:45.720408 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:45.720984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:45.916582 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:45.929793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dc2f653e-5ebf-43ce-a15e-e09677c3f13e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.251841 May 18 22:41:45.930835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 34/77] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:45 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:46.002455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:46.003144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:46.012123 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:46.012841 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:46.014861 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:46.015538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:46.058825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:46.186788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:46.195894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4fb8f019-7d34-42c4-8517-fe29c55127f8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.198444 May 18 22:41:46.196979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 44/78] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:45 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:46.669057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:46.670126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:46.682834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:46.685521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:46.685521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:46.685521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:46.774857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:46.791099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c72afa0a-65e3-4145-b1f7-c0d1d65c8c8f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.128114 May 18 22:41:46.804229 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 35/79] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:46 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:46.947251 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:46.948608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:46.956826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:46.959421 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:46.959421 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:46.959421 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:47.224127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:47.236530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e8220702-6dd4-4093-8064-f66b56585cd9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.293238 May 18 22:41:47.246870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 45/80] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:46 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:47.253562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:47.254543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:47.262508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:47.263678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:47.265455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:47.266134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:47.428619 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ab051b49-c445-4d3c-b915-531690b7a3ba tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Action: 'create', calling method: .version_select at 0x7f6cd9abe9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-561641596", "metadata": {"Type": "work"}}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ab051b49-c445-4d3c-b915-531690b7a3ba tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Request method failure captured: May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 121 May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYrGoGrR6-1auTgyJup1qp76DRlM7knPBtRq50uMHF7lkgCbpS6Sx-Xv3XPvzjcBVcx9xSjFNWVY0uvrEtJm6TpKpDxC8T-C5odImSXu_bsL1Cfb9-KDRhcMM8RtPy9ZrygA159lOlWcDIcu_hs5hHrRnq2C4fSiQWGnUNHjtlFeak May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:47.439749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfe916805688431abc5d305c76358b04", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfe916805688431abc5d305c76358b04"}]}] May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 9a07da0bc25a4e9ab219d56e3536890c May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-561641596", "metadata": {"Type": "work"}}} May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:47.448241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-561641596', 'metadata': {'Type': 'work'}}}} May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise error May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi '#$%' May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:47.450727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 22:41:47.454554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 22:41:47.457727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 22:41:47.457727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.457727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ab051b49-c445-4d3c-b915-531690b7a3ba tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:47.457727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ab051b49-c445-4d3c-b915-531690b7a3ba tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.230890 May 18 22:41:47.457727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 36/81] 10.222.0.70 () {60 vars in 1155 bytes} [Wed May 18 22:41:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 22:41:47.457727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-27b6d54a-0e8f-4e6d-95c1-424bf6dd5b94 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Action: 'create', calling method: .version_select at 0x7f6cd9b37a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1445381777", "metadata": {"Type": "work"}}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-27b6d54a-0e8f-4e6d-95c1-424bf6dd5b94 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Request method failure captured: May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 120 May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYrGoGrR6-1auTgyJup1qp76DRlM7knPBtRq50uMHF7lkgCbpS6Sx-Xv3XPvzjcBVcx9xSjFNWVY0uvrEtJm6TpKpDxC8T-C5odImSXu_bsL1Cfb9-KDRhcMM8RtPy9ZrygA159lOlWcDIcu_hs5hHrRnq2C4fSiQWGnUNHjtlFeak May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:47.460363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfe916805688431abc5d305c76358b04", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfe916805688431abc5d305c76358b04"}]}] May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 9a07da0bc25a4e9ab219d56e3536890c May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1445381777", "metadata": {"Type": "work"}}} May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:47.463290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1445381777', 'metadata': {'Type': 'work'}}}} May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise error May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi '0' May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:47.466617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 22:41:47.469590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 22:41:47.474583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 22:41:47.474583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.474583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-27b6d54a-0e8f-4e6d-95c1-424bf6dd5b94 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:47.474583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-27b6d54a-0e8f-4e6d-95c1-424bf6dd5b94 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014206 May 18 22:41:47.474583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 37/82] 10.222.0.70 () {60 vars in 1155 bytes} [Wed May 18 22:41:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 22:41:47.483170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8742b929-0bae-495a-88b7-b3bd671b2e65 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Action: 'create', calling method: .version_select at 0x7f6cd9be9160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1224439431", "metadata": {"Type": "work"}}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8742b929-0bae-495a-88b7-b3bd671b2e65 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Request method failure captured: May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 119 May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYrGoGrR6-1auTgyJup1qp76DRlM7knPBtRq50uMHF7lkgCbpS6Sx-Xv3XPvzjcBVcx9xSjFNWVY0uvrEtJm6TpKpDxC8T-C5odImSXu_bsL1Cfb9-KDRhcMM8RtPy9ZrygA159lOlWcDIcu_hs5hHrRnq2C4fSiQWGnUNHjtlFeak May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:47.485832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfe916805688431abc5d305c76358b04", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfe916805688431abc5d305c76358b04"}]}] May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 9a07da0bc25a4e9ab219d56e3536890c May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1224439431", "metadata": {"Type": "work"}}} May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:47.489243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1224439431', 'metadata': {'Type': 'work'}}}} May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise error May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi '' May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:47.490453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 22:41:47.492001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 22:41:47.492978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 22:41:47.492978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.492978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8742b929-0bae-495a-88b7-b3bd671b2e65 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:47.492978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8742b929-0bae-495a-88b7-b3bd671b2e65 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025328 May 18 22:41:47.495574 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:47.498871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 38/83] 10.222.0.70 () {60 vars in 1155 bytes} [Wed May 18 22:41:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 22:41:47.503716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-97e1d0f5-b979-45f1-acee-69644f36aeaf tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Calling method '.version_select at 0x7f6cd9ba21f0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:47.507219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6e63373c-38f4-4db2-b3d3-0840fa2640c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.258003 May 18 22:41:47.512430 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 46/84] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:47 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:47.537714 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-97e1d0f5-b979-45f1-acee-69644f36aeaf tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] HTTP exception thrown: Volume tempest-invalid-891801388 could not be found. May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-97e1d0f5-b979-45f1-acee-69644f36aeaf tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Request method failure captured: May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-891801388 HTTP/1.1 May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYrGoGrR6-1auTgyJup1qp76DRlM7knPBtRq50uMHF7lkgCbpS6Sx-Xv3XPvzjcBVcx9xSjFNWVY0uvrEtJm6TpKpDxC8T-C5odImSXu_bsL1Cfb9-KDRhcMM8RtPy9ZrygA159lOlWcDIcu_hs5hHrRnq2C4fSiQWGnUNHjtlFeak May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:47.539783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfe916805688431abc5d305c76358b04", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfe916805688431abc5d305c76358b04"}]}] May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 9a07da0bc25a4e9ab219d56e3536890c May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Volume tempest-invalid-891801388 could not be found. May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'tempest-invalid-891801388'} May 18 22:41:47.541150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-891801388 could not be found. (HTTP 404) (Request-ID: req-d1160327-9723-4fa4-8561-08bc04539785) May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.542056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 22:41:47.543407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-891801388 could not be found. May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:47.545615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-891801388 could not be found. May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-891801388 could not be found. May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-97e1d0f5-b979-45f1-acee-69644f36aeaf tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Returning 404 to user: Volume tempest-invalid-891801388 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-97e1d0f5-b979-45f1-acee-69644f36aeaf tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-891801388" status: 404 len: 98 microversion: 2.1 time: 0.041359 May 18 22:41:47.547009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 39/85] 10.222.0.70 () {58 vars in 1214 bytes} [Wed May 18 22:41:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-891801388 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 18 22:41:47.551934 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2d7f849e-83f7-42b3-835b-182f08532887 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003899 May 18 22:41:47.552430 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 47/86] 10.222.0.70 () {58 vars in 1139 bytes} [Wed May 18 22:41:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 18 22:41:47.561754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a106835a-4cc7-450e-9b41-c5166533a663 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004682 May 18 22:41:47.562396 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 40/87] 10.222.0.70 () {58 vars in 1136 bytes} [Wed May 18 22:41:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 18 22:41:47.570921 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1f63dabc-a1b7-4ac6-b8e3-94e8d6585ba7 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Calling method '.version_select at 0x7f6cda3f5670>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:47.599030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-1f63dabc-a1b7-4ac6-b8e3-94e8d6585ba7 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] HTTP exception thrown: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1f63dabc-a1b7-4ac6-b8e3-94e8d6585ba7 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Request method failure captured: May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/os-volumes/1a5b18eb-be5f-4e76-884b-fe27b4846734 HTTP/1.1 May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYrGoGrR6-1auTgyJup1qp76DRlM7knPBtRq50uMHF7lkgCbpS6Sx-Xv3XPvzjcBVcx9xSjFNWVY0uvrEtJm6TpKpDxC8T-C5odImSXu_bsL1Cfb9-KDRhcMM8RtPy9ZrygA159lOlWcDIcu_hs5hHrRnq2C4fSiQWGnUNHjtlFeak May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:41:47.605052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfe916805688431abc5d305c76358b04", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfe916805688431abc5d305c76358b04"}]}] May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 9a07da0bc25a4e9ab219d56e3536890c May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '1a5b18eb-be5f-4e76-884b-fe27b4846734'} May 18 22:41:47.606234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. (HTTP 404) (Request-ID: req-966c3824-7a52-4243-93bd-312d27e0306b) May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.607998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 22:41:47.609194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 22:41:47.610640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1f63dabc-a1b7-4ac6-b8e3-94e8d6585ba7 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Returning 404 to user: Volume 1a5b18eb-be5f-4e76-884b-fe27b4846734 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1f63dabc-a1b7-4ac6-b8e3-94e8d6585ba7 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/1a5b18eb-be5f-4e76-884b-fe27b4846734" status: 404 len: 109 microversion: 2.1 time: 0.035315 May 18 22:41:47.612178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 48/88] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:41:47 2022] DELETE /compute/v2.1/os-volumes/1a5b18eb-be5f-4e76-884b-fe27b4846734 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:41:47.616207 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9316fe20-8ce7-4891-a582-229239b067c1 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Calling method '.version_select at 0x7f6cd9abe040>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:47.643104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-9316fe20-8ce7-4891-a582-229239b067c1 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] HTTP exception thrown: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9316fe20-8ce7-4891-a582-229239b067c1 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Request method failure captured: May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/os-volumes/0fb45135-4a38-439f-ae03-be0c44fa78fd HTTP/1.1 May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYrGoGrR6-1auTgyJup1qp76DRlM7knPBtRq50uMHF7lkgCbpS6Sx-Xv3XPvzjcBVcx9xSjFNWVY0uvrEtJm6TpKpDxC8T-C5odImSXu_bsL1Cfb9-KDRhcMM8RtPy9ZrygA159lOlWcDIcu_hs5hHrRnq2C4fSiQWGnUNHjtlFeak May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:41:47.645051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfe916805688431abc5d305c76358b04", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfe916805688431abc5d305c76358b04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfe916805688431abc5d305c76358b04"}]}] May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: cfe916805688431abc5d305c76358b04 May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesNegativeTest-2077061160 May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 9a07da0bc25a4e9ab219d56e3536890c May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesNegativeTest-2077061160-project May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '0fb45135-4a38-439f-ae03-be0c44fa78fd'} May 18 22:41:47.646421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. (HTTP 404) (Request-ID: req-86e01e82-d74b-45cb-b84c-4656d120c7b2) May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.647362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 22:41:47.648956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 22:41:47.650324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9316fe20-8ce7-4891-a582-229239b067c1 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] Returning 404 to user: Volume 0fb45135-4a38-439f-ae03-be0c44fa78fd could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:41:47.652339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9316fe20-8ce7-4891-a582-229239b067c1 tempest-VolumesNegativeTest-2077061160 tempest-VolumesNegativeTest-2077061160-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0fb45135-4a38-439f-ae03-be0c44fa78fd" status: 404 len: 109 microversion: 2.1 time: 0.035483 May 18 22:41:47.657027 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 41/89] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:47 2022] GET /compute/v2.1/os-volumes/0fb45135-4a38-439f-ae03-be0c44fa78fd => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:41:47.815462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:47.816068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:47.829518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:47.829518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:47.829518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:47.829518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:47.886069 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:47.895595 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6f1aa2d1-d6db-4b64-b057-a639f9bc5856 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.083772 May 18 22:41:47.896221 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 49/90] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:47 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:48.253619 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:48.254827 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:48.261433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:48.261888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:48.262834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:48.264410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:48.465069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:48.474316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a12d828b-05b7-47be-940b-c231f7de640d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.224731 May 18 22:41:48.474892 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 42/91] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:48 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:48.527280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:48.527948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:48.534317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:48.534758 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:48.535659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:48.536093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:48.702484 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:48.711224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b92cf847-5f2c-43af-9f9d-773987ede93f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.187847 May 18 22:41:48.711791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 50/92] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:48 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:48.912753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:48.913357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:48.919329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:48.920385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:48.921134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:48.921564 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:49.001746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:49.011446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-381f3747-d02c-4aed-8913-aa6ad7032f72 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.100497 May 18 22:41:49.014107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 43/93] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:48 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:49.499769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:49.500680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:49.508261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:49.508653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:49.509688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:49.510238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:49.661330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:49.672855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3bf2cf01-a27c-479b-b7ae-ab8d9e568516 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.184962 May 18 22:41:49.673850 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 51/94] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:49 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:49.727661 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:49.732638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:49.732638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=8 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:49.732638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=24 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:49.736059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:49.736569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:49.737386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:49.737882 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:49.894444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:49.901893 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8a0582bc-d5f6-4662-806b-0f0932a2d6b8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.178103 May 18 22:41:49.902497 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 44/95] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:49 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:50.026114 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:50.026946 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:50.028822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=14 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:50.033688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:50.034174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:50.034935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:50.035365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:50.099817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:50.107298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-155fad3b-7cea-4fbc-8a59-c2c09a539fb5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.084933 May 18 22:41:50.107863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 52/96] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:50 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:50.693087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:50.693710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:50.699918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:50.700652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:50.701817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:50.702488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:50.877112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:50.885477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-10b332dc-07b8-46ed-b31e-90d4d5522453 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.197624 May 18 22:41:50.886380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 45/97] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:50 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:50.919045 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:50.920993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:50.927563 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:50.928313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:50.929292 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:50.930023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:51.130236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:51.132246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:51.132858 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:51.140276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a3d1dc01-55c2-4349-a2cd-1535ab4d3a26 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.225122 May 18 22:41:51.146087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 53/98] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:50 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:51.146733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:51.148753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:51.149537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:51.149973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:51.241962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:51.251705 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f19c12d8-2110-420c-a737-98f92bcb31a4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.130663 May 18 22:41:51.267353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 46/99] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:51 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:51.903075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:51.903676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:51.910556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:51.911003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:51.911762 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:51.912191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:52.041984 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:52.050194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-577b1f94-f464-4a05-ba58-2e5e47b56444 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.150973 May 18 22:41:52.050770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 54/100] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:51 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:52.157807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:52.158482 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:52.164511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:52.164962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:52.165739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:52.166213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:52.171631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:52.270837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:52.271753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:52.291765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:52.292475 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:52.293489 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:52.294182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:52.386701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:52.390357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:52.394979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e5f3c847-afeb-4646-96a6-f4f4e250930f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.129947 May 18 22:41:52.398988 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 55/101] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:52 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:52.399141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f6d14c71-7401-4a84-8a65-1a7a2c6bf612 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.244643 May 18 22:41:52.399141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 47/102] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:52 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:53.067452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:53.068056 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:53.074286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:53.074784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:53.075540 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:53.077142 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:53.207080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:53.214347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-42edc09b-6743-47c4-8b3c-fda8dabcabea tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.150674 May 18 22:41:53.214942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 56/103] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:53 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:53.413259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:53.413872 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:53.414466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:53.415072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:53.417071 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:53.421233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:53.421593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:53.421737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:53.422118 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:53.422489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:53.422872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:53.422971 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:53.423302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:53.492858 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:53.501676 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aae2f336-0bbc-4005-bb24-0b63cf75e274 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.092337 May 18 22:41:53.508248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 48/104] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:53 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:53.583542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:53.593323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9612da34-6528-4658-b0a0-023cc42b4be7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.182323 May 18 22:41:53.593911 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 57/105] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:53 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:54.231545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:54.233002 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:54.239435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:54.239889 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:54.240665 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:54.241105 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:54.382838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:54.391211 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d5cf3c3e-8a48-472a-ac28-a240f320fc18 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.163471 May 18 22:41:54.391794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 49/106] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:54 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:54.519395 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:54.520004 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:54.526027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:54.526481 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:54.527249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:54.527683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:54.588918 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:54.596646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-908051c7-2bfe-435d-aaa0-82dcd045968c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.081146 May 18 22:41:54.597211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 58/107] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:54 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:54.619648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:54.620261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:54.626889 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:54.627339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:54.628101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:54.628540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:54.757539 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:54.765117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d71ae533-315c-4268-820f-923ac735bd90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.159077 May 18 22:41:54.765670 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 50/108] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:54 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:55.408040 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:55.408645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:55.414817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:55.415263 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:55.416026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:55.416461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:55.555986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:55.565626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c80f9626-c81d-4238-9b31-8b253d9a74cf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.161171 May 18 22:41:55.566337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 59/109] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:55 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:55.625906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:55.626541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:55.632848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:55.633290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:55.634076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:55.634520 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:55.694637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:55.703091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2eefdf2f-19cd-4125-bb46-6dd88a6f513e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.082316 May 18 22:41:55.703650 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 51/110] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:55 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:55.784961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:55.785569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:55.791668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:55.792119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:55.792893 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:55.793351 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:55.931009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:55.938599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7cbb7e13-ba0b-4ddd-81d2-c60eb2452e39 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.160168 May 18 22:41:55.939175 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 60/111] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:55 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:56.607771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:56.607771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:56.607771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:56.607771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:56.608341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:56.608341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:56.722016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:56.723963 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:56.731298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:56.738321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:56.738321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:56.738899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:56.739396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:56.743728 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:56.752551 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-45181b8b-9508-4011-9761-b7b64522fbc1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.173429 May 18 22:41:56.753126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 52/112] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:56 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:56.815804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:56.823790 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c8136e11-9a79-4060-9b00-6b1910e7855b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.107604 May 18 22:41:56.824437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 61/113] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:56 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:56.955401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:56.956010 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:56.962065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:56.962518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:56.963279 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:56.963775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:57.097591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:57.105254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-51af77b2-230a-4ec9-9494-419323ab49c2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.153739 May 18 22:41:57.108134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 53/114] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:56 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:57.770180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:57.771408 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:57.778139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:57.778587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:57.780784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:57.781223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:57.843392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:57.844607 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:57.850597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:57.851161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:57.852263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:57.853053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:57.955585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:57.970683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-68bdaf70-9e9c-4dc4-ae3b-d9df1e2bfcc4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.204081 May 18 22:41:57.970950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:57.972212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 62/115] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:57 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:57.978393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4025b074-d8d1-4473-9fc2-5574172e2df6 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cda3f5940>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:57.992874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd3985d4-8e98-487a-83a5-6ea6f5408af7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1312 microversion: 2.1 time: 0.153036 May 18 22:41:57.992874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 54/116] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:57 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:58.122947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:58.123508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:58.129512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:58.129884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:58.130674 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:58.131112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:58.266572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:58.285795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-904f5aa5-cb19-4fef-b101-e11f3f5eef0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.166238 May 18 22:41:58.286440 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 55/117] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:58 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:41:58.477810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4025b074-d8d1-4473-9fc2-5574172e2df6 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/128e1f60-7c0b-4a89-934d-a2df6c1be556" status: 200 len: 350 microversion: 2.1 time: 0.504221 May 18 22:41:58.478467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 63/118] 10.222.0.70 () {58 vars in 1244 bytes} [Wed May 18 22:41:57 2022] GET /compute/v2.1/os-volumes/128e1f60-7c0b-4a89-934d-a2df6c1be556 => generated 350 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:58.492905 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de27922d-9f66-443c-a805-00f62d5edbf3 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cd9abe670>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:58.640267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de27922d-9f66-443c-a805-00f62d5edbf3 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.153080 May 18 22:41:58.640921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 56/119] 10.222.0.70 () {58 vars in 1133 bytes} [Wed May 18 22:41:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:58.655527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-493d2522-46ba-4a99-9982-539c5ca56a68 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cda3f5820>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:58.804433 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-493d2522-46ba-4a99-9982-539c5ca56a68 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.153690 May 18 22:41:58.806065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 64/120] 10.222.0.70 () {58 vars in 1148 bytes} [Wed May 18 22:41:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:58.820160 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6447822b-563d-47b1-ae6c-e54c68bd8317 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cd9b89f70>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:58.931126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6447822b-563d-47b1-ae6c-e54c68bd8317 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.114591 May 18 22:41:58.932329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 57/121] 10.222.0.70 () {58 vars in 1133 bytes} [Wed May 18 22:41:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:58.945805 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8a789484-99bd-4622-8a6e-c02f03394dc0 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cda3c53a0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:58.990243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:58.992725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:59.001976 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:59.003958 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:59.003958 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:59.004159 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:59.056824 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8a789484-99bd-4622-8a6e-c02f03394dc0 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.116802 May 18 22:41:59.058682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 65/122] 10.222.0.70 () {58 vars in 1166 bytes} [Wed May 18 22:41:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:41:59.070081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:59.070926 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:59.077526 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:59.078051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:59.078822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:59.079439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:59.083881 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:41:59.286885 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:59.294775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9c52da17-1add-467c-a966-a0b5279dcac5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1300 microversion: 2.1 time: 0.228357 May 18 22:41:59.295595 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 66/123] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:59 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:59.301845 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6be40024-5550-4fd4-a1c3-488ef1b52e4c tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cda3c5820>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:59.386832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6be40024-5550-4fd4-a1c3-488ef1b52e4c tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090021 May 18 22:41:59.392845 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 67/124] 10.222.0.70 () {58 vars in 1169 bytes} [Wed May 18 22:41:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:59.400975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:59.401608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:41:59.409412 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:59.409956 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:59.410834 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:41:59.411353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:41:59.450615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:59.463212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9db38706-b7ef-4c58-ab8b-4f4d8dacec99 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.476974 May 18 22:41:59.464546 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 58/125] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:58 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:59.486697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-87925079-d2f7-4486-978d-381b448fbdcd tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cd9bbce50>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:59.616642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-87925079-d2f7-4486-978d-381b448fbdcd tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.150661 May 18 22:41:59.617917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 59/126] 10.222.0.70 () {58 vars in 1154 bytes} [Wed May 18 22:41:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:59.630665 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a7348f09-814c-4b68-9fe8-1a3d9c691994 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cd9b37af0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:59.738817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a7348f09-814c-4b68-9fe8-1a3d9c691994 tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105325 May 18 22:41:59.738817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 60/127] 10.222.0.70 () {58 vars in 1187 bytes} [Wed May 18 22:41:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:41:59.744029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bfa5a9fa-cefa-4b7f-ac7e-e893568c29cb tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] Calling method '.version_select at 0x7f6cd9b89280>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:41:59.858607 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:41:59.867104 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b0687eb3-8f8e-43c9-9d69-b58088ef3bc6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.476524 May 18 22:41:59.867694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 68/128] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:41:59 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:41:59.880111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bfa5a9fa-cefa-4b7f-ac7e-e893568c29cb tempest-VolumesTestJSON-295017878 tempest-VolumesTestJSON-295017878-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.139775 May 18 22:41:59.880699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 61/129] 10.222.0.70 () {58 vars in 1154 bytes} [Wed May 18 22:41:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:00.315624 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:00.316942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:00.326162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.333100 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-c1d857ee-9581-427e-9487-46bb8adba55e req-11c6103b-1f5e-47b9-bfcf-8f803b9e7a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76212507-6655-4eae-b27d-239e5e349b46", "tag": "2ade8e46-0efa-484e-835b-4b4ce42c3411"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:00.334531 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.335467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.336048 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.351861 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c1d857ee-9581-427e-9487-46bb8adba55e req-11c6103b-1f5e-47b9-bfcf-8f803b9e7a33 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.362826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c1d857ee-9581-427e-9487-46bb8adba55e req-11c6103b-1f5e-47b9-bfcf-8f803b9e7a33 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.376468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-c1d857ee-9581-427e-9487-46bb8adba55e req-11c6103b-1f5e-47b9-bfcf-8f803b9e7a33 service nova] Creating event network-changed:2ade8e46-0efa-484e-835b-4b4ce42c3411 for instance 76212507-6655-4eae-b27d-239e5e349b46 on hv-cinder-83800 May 18 22:42:00.377109 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c1d857ee-9581-427e-9487-46bb8adba55e req-11c6103b-1f5e-47b9-bfcf-8f803b9e7a33 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 18 22:42:00.378317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.379005 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.379881 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.380717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.395614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.compute.rpcapi [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 18 22:42:00.401854 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] Releasing lock "compute-rpcapi-router" {{(pid=124366) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 18 22:42:00.425685 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fcfa8a0e-8cca-4a96-8eff-a4a6a8ee2343 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174390 May 18 22:42:00.434215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 69/130] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:42:00.484449 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:00.488094 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:00.492735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.493191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.493952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.494642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.644439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:00.653372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-358879e3-cabc-4db1-a23d-d3f81a9701c6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.343917 May 18 22:42:00.657891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 62/131] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:00 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:00.770098 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-6c2c50ac-7fc0-4e01-956b-c987cdd445fc req-6d0e0cd7-99ea-4392-b708-a279283eb9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da5b596-3bb2-490e-b163-0649fbbc2657", "tag": "fdb36b10-d6f4-4a5f-be73-d46b3a0b5721"}, {"name": "network-changed", "server_uuid": "70925c7e-8a38-4cd6-a8ff-7b66a613265c", "tag": "bf37ad73-6cb2-476c-b1e5-21bc440a86e1"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:00.785929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6c2c50ac-7fc0-4e01-956b-c987cdd445fc req-6d0e0cd7-99ea-4392-b708-a279283eb9b3 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.786561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6c2c50ac-7fc0-4e01-956b-c987cdd445fc req-6d0e0cd7-99ea-4392-b708-a279283eb9b3 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.790611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:00.801012 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7f797d0b-f72e-479e-8f5c-2c2e8ecb45d6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.324233 May 18 22:42:00.801602 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 70/132] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:00 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:00.809286 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-6c2c50ac-7fc0-4e01-956b-c987cdd445fc req-6d0e0cd7-99ea-4392-b708-a279283eb9b3 service nova] Creating event network-changed:fdb36b10-d6f4-4a5f-be73-d46b3a0b5721 for instance 5da5b596-3bb2-490e-b163-0649fbbc2657 on hv-cinder-83800 May 18 22:42:00.809718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-6c2c50ac-7fc0-4e01-956b-c987cdd445fc req-6d0e0cd7-99ea-4392-b708-a279283eb9b3 service nova] Creating event network-changed:bf37ad73-6cb2-476c-b1e5-21bc440a86e1 for instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c on hv-cinder-83800 May 18 22:42:00.810946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6c2c50ac-7fc0-4e01-956b-c987cdd445fc req-6d0e0cd7-99ea-4392-b708-a279283eb9b3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 18 22:42:00.812186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.812672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.813449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.813876 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.822327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.compute.rpcapi [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 18 22:42:00.823171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] Releasing lock "compute-rpcapi-router" {{(pid=124367) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 18 22:42:00.839248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d654f7e3-d78d-485f-992c-f1c7890d0daa None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.133304 May 18 22:42:00.839924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 63/133] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:42:00.884421 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:00.885031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:00.891684 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.892132 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:00.892900 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:00.893352 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:01.019492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:01.026801 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-02e5f290-c93d-41ab-b7e6-016a8716cbe1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.146099 May 18 22:42:01.027362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 71/134] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:00 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:01.672945 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:01.673644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:01.679832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:01.680541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:01.681441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:01.681707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:01.814998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:01.817775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:01.818419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:01.823494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ee623a36-a702-485e-89ce-30215ab526a5 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.154710 May 18 22:42:01.824217 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 64/135] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:01 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:01.824777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:01.825228 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:01.826649 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:01.827427 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:01.993844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:01.993844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f2bdbce3-260b-4710-b546-7610d6d2221e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.154006 May 18 22:42:01.993844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 72/136] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:01 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:02.043173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:02.043852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:02.050560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:02.051010 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:02.051765 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:02.052197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:02.194847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:02.202598 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-583f33eb-bb3a-4636-bb04-59b2905c02f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.163311 May 18 22:42:02.203285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 65/137] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:02 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:02.842390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:02.843023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:02.849075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:02.849590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:02.850391 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:02.850831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:02.977518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:02.985828 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-398912e8-4ecd-4af8-981d-9c4f761b6e27 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.147803 May 18 22:42:02.986420 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 73/138] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:02 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:03.007484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:03.008011 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:03.014139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:03.014585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:03.015348 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:03.015781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:03.142523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:03.149846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-34e726aa-d6d4-4745-8155-8d7a0a99720c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.146184 May 18 22:42:03.150517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 66/139] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:03 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:03.219098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:03.219633 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:03.225624 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:03.226113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:03.226876 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:03.227316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:03.378638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:03.386354 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b7826e8b-bae5-4d84-81f6-309d23dedd75 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.171028 May 18 22:42:03.388942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 74/140] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:03 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:04.003469 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:04.004131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:04.010463 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.010976 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.011671 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.012106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.166310 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:04.166923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:04.173618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.175566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.175566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.175566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.487901 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:04.498131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b92145a1-3d24-4ee3-af4f-07d41c8e8e28 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.498144 May 18 22:42:04.499781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 67/141] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:03 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:04.514215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:04.515032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:04.521853 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.533853 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.533853 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.533853 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.581212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:04.596275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8767ca3e-d4c0-41fd-a640-618a901e7b48 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.433346 May 18 22:42:04.605598 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 75/142] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:04 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:04.733339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:04.743105 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-df16d2cf-c5c7-482b-af57-b4a0da382832 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.241828 May 18 22:42:04.743679 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 68/143] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:04 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:04.833746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-b0f0186f-93da-4667-85db-7f5526e33a03 req-ce85fa9e-47da-4d71-a8f5-03866fdaa9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097a1c9f-e116-4327-a473-ab82fe379d7f", "tag": "d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:04.842961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-b0f0186f-93da-4667-85db-7f5526e33a03 req-ce85fa9e-47da-4d71-a8f5-03866fdaa9d7 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:04.843462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-b0f0186f-93da-4667-85db-7f5526e33a03 req-ce85fa9e-47da-4d71-a8f5-03866fdaa9d7 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:04.858776 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-b0f0186f-93da-4667-85db-7f5526e33a03 req-ce85fa9e-47da-4d71-a8f5-03866fdaa9d7 service nova] Creating event network-changed:d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7 for instance 097a1c9f-e116-4327-a473-ab82fe379d7f on hv-cinder-83800 May 18 22:42:04.863864 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-b0f0186f-93da-4667-85db-7f5526e33a03 req-ce85fa9e-47da-4d71-a8f5-03866fdaa9d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033777 May 18 22:42:04.868216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 76/144] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:42:05.515768 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:05.516400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:05.522323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:05.522774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:05.523534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:05.523982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:05.528017 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:05.613167 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:05.613877 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:05.620070 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:05.620514 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:05.621275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:05.621704 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:05.652966 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:05.661179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-26a46a25-f1ea-48c3-ab64-d01ad292cca4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.149417 May 18 22:42:05.661758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 69/145] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:05 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:05.750680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:05.758667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-40cd5ab2-4c04-4ee6-9bfe-2844cda3115c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.149539 May 18 22:42:05.759403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 77/146] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:05 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:05.759605 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:05.760553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:05.767846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:05.768291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:05.769324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:05.770419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:05.896453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:05.904671 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-79488ea2-87d5-433b-afa6-f4c6845302ba tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.147834 May 18 22:42:05.905255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 70/147] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:05 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:06.678204 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:06.678878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:06.685751 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:06.686229 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:06.686986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:06.687420 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:06.776590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:06.777056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:06.782995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:06.783443 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:06.784211 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:06.784638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:06.822757 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:06.830409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d140c42a-2530-44a0-bfa1-0b23e6ee1c01 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.156003 May 18 22:42:06.830987 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 78/148] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:06 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:06.914792 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:06.921370 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:06.922020 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:06.923085 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fcd2b4a0-44a4-45a2-bf9b-50db72235a43 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.150608 May 18 22:42:06.923651 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 71/149] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:06 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:06.928365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:06.928811 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:06.929613 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:06.930326 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:07.056675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:07.064108 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-22169267-77bc-4bed-9de7-cc1592f04cb1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.147310 May 18 22:42:07.064771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 79/150] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:06 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:07.847498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:07.848111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:07.854037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:07.854495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:07.855244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:07.855678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:07.940650 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:07.941289 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:07.947781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:07.948232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:07.949007 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:07.949444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:07.995377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:08.003949 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-104d31de-0cdf-4b6d-b88e-b57209816a12 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.160098 May 18 22:42:08.014464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 72/151] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:07 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:08.081357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:08.081873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:08.083772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:08.087946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:08.088390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:08.089184 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:08.089606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:08.093174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b466811f-4c79-4945-a2ca-f44fc9ff1419 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.156333 May 18 22:42:08.093639 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 80/152] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:07 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:08.407927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:08.418183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-12f8c7b4-97b3-4260-9c1a-7b32d2a5dc9a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.338281 May 18 22:42:08.418183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 73/153] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:08 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:09.021533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:09.022192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:09.028141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:09.028590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:09.029480 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:09.029908 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:09.110433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:09.111047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:09.117545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:09.117985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:09.121542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:09.121542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:09.176057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:09.183916 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8b5cef64-3e52-485e-a454-10062e24d83c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.166243 May 18 22:42:09.184485 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 81/154] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:09 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:09.260210 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:09.267802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a45f4a2-062b-423e-8726-6544d0a5f65a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.161874 May 18 22:42:09.268372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 74/155] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:09 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:09.432597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:09.433208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:09.439733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:09.440182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:09.440947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:09.444053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:09.571834 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:09.579276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b7bf8f7b-83f5-4ae0-a9b6-3f64442e2ce9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.150696 May 18 22:42:09.579837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 82/156] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:09 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:10.204630 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:10.205276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:10.211346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:10.211790 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:10.212560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:10.212990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:10.286682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:10.287371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:10.293575 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:10.294834 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:10.295880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:10.296409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:10.385124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:10.393917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-96a68e57-6dbd-4deb-bb67-5c1f907336de tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.194691 May 18 22:42:10.394570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 75/157] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:10 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:10.394938 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:10.447940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:10.456403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ef6bb831-f633-4aad-90ce-c3a6645ad467 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.175130 May 18 22:42:10.458945 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 83/158] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:10 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:10.596374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:10.596988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:10.602907 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:10.603359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:10.604119 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:10.604555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:10.736394 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:10.743824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de18d9ec-d919-4e74-b366-8f398ef179f4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.151227 May 18 22:42:10.744389 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 76/159] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:10 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:11.411882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:11.412559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:11.418813 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:11.419314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:11.420367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:11.420803 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:11.473315 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:11.473926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:11.475786 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:11.480571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:11.481013 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:11.481790 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:11.482570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:11.590156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:11.594928 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:11.600145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-81cc4d71-66d3-4898-b283-9eee0b4ba29a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.192053 May 18 22:42:11.600724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 84/160] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:11 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:11.649753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:11.657136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b68a2d82-a58e-4d4f-91a7-631a08c0040a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.187595 May 18 22:42:11.657705 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 77/161] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:11 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:11.760528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:11.761133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:11.767774 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:11.768224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:11.769019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:11.769456 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:11.899155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:11.907449 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ffcae62c-823b-406d-865b-b9154cdc88c3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.150909 May 18 22:42:11.908032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 85/162] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:11 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:12.617825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:12.618405 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:12.625056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:12.625489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:12.626276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:12.626701 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:12.675230 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:12.675848 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:12.682429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:12.682887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:12.683649 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:12.684314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:12.800455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:12.808450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ba721122-1399-4e67-9c0f-d39da05605a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.194380 May 18 22:42:12.809034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 78/163] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:12 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:12.844991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:12.852519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5b84d954-c2c8-4d3f-b744-e100df9ec07f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.181855 May 18 22:42:12.853274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 86/164] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:12 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:12.923626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:12.924223 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:12.930636 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:12.931080 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:12.931873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:12.932303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:13.061350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:13.068730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1b4a6823-0691-4299-b1fc-453484b43fc9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.149030 May 18 22:42:13.069310 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 79/165] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:12 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:13.826999 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:13.827607 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:13.833645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:13.835546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:13.835546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:13.835546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:13.869773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:13.870395 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:13.877060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:13.877502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:13.878307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:13.878738 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:14.017065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:14.024488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-430cccdb-f9f1-4eee-8b86-94523bbbc01c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.201866 May 18 22:42:14.025053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 87/166] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:13 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:14.047319 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:14.054751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a9114164-8f77-422c-8f90-dede7e19eacb tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.188766 May 18 22:42:14.055670 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 80/167] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:13 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:14.084437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:14.085037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:14.091431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:14.091879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:14.092627 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:14.093055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:14.223182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:14.230753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d0eb9fd4-b5f0-4f71-8420-15bef3b53b4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.149960 May 18 22:42:14.231320 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 88/168] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:14 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:15.042031 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:15.042556 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:15.050224 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:15.050686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:15.051513 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:15.052111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:15.070718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:15.071394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:15.077832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:15.078327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:15.079181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:15.079616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:15.273183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:15.280242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:15.282483 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-086580b0-0aa3-46c5-9c5d-0c999abc9013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.244514 May 18 22:42:15.283073 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 81/169] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:15 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:15.287484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:15.288083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:15.293855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:15.294254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:15.295674 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:15.296104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:15.296792 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-132ff722-37e9-4061-897d-21eb9c25a493 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.229775 May 18 22:42:15.297377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 89/170] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:15 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:15.434091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:15.442691 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b75e1214-f1ff-4522-b259-0f15e600ebbd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.158676 May 18 22:42:15.443251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 82/171] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:15 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:16.300559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:16.301107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:16.307339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:16.307786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:16.308548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:16.308984 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:16.315291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:16.315818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:16.322030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:16.327896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:16.327896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:16.327896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:16.527468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:16.536257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a7cb1a3a-7e99-42cb-9d3b-8e456174fe3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.239787 May 18 22:42:16.536830 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 90/172] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:16 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:16.551060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:16.551675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:16.557306 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:16.559306 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:16.559812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:16.560637 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:16.561073 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:16.566452 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2016e9f6-26b1-440f-8af3-699f33565ee8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.255396 May 18 22:42:16.566924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 83/173] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:16 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:16.694699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:16.703088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f44c3067-b5c0-4bff-8408-aa373b05938f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.156128 May 18 22:42:16.703512 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 91/174] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:16 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:17.553289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:17.553889 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:17.560054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:17.560493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:17.564545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:17.564545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:17.583736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:17.585166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:17.591456 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:17.592189 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:17.593014 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:17.593439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:17.750083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:17.758492 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bcbee5ff-11ea-4185-be39-7c982f494e33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.208817 May 18 22:42:17.759061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 84/175] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:17 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:17.764173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:17.764826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:17.771113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:17.771818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:17.772763 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:17.773345 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:17.781345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:17.788853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-858569a7-c8ec-4a9c-bec9-e1fcd389a3bf tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.209050 May 18 22:42:17.789598 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 92/176] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:17 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:17.909157 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:17.912884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:17.917282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3070d002-c652-4009-a5a0-a66faec052e1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.157111 May 18 22:42:17.917923 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 85/177] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:17 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:18.779424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:18.780026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:18.786553 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:18.787017 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:18.787775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:18.788202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:18.807695 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:18.808416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:18.814954 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:18.815355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:18.816098 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:18.816656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:18.989666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:18.992898 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:18.999863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f6728504-d6b0-4764-b305-993250dc84c2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.224232 May 18 22:42:19.000448 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-49ad570c-6a71-42d6-aca9-42b89934498d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.197203 May 18 22:42:19.000962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 93/178] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:18 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:19.001082 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 86/179] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:18 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:19.005376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:19.005962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:19.011799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:19.012241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:19.012989 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:19.013423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:19.149410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:19.178751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aeee1639-8087-451d-8a9b-3b6b8af1225e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.176572 May 18 22:42:19.180422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 87/180] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:19 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:20.016374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:20.016890 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:20.017260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:20.017468 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:20.023777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:20.024218 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:20.024321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:20.024692 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:20.024983 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:20.025413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:20.025529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:20.025874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:20.224773 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:20.228252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:20.238291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e75b2cc-f2ae-4aab-8040-c573f7ba9175 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.225516 May 18 22:42:20.248116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a049fd3d-575b-477c-8845-460024c363be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.227386 May 18 22:42:20.248116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 94/181] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:20 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:20.248116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:20.248116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:20.249412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 88/182] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:20 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:20.253930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:20.254411 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:20.255166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:20.255595 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:20.383937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:20.391952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3443f973-9ddf-42dd-8dec-d0672967e500 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.150306 May 18 22:42:20.392455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 95/183] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:20 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:21.255032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:21.255821 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:21.258394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:21.259439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:21.262138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:21.262583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:21.263565 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:21.263996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:21.267409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:21.267955 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:21.268865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:21.269305 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:21.626593 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:21.644687 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:21.645143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd3aeb45-0855-40cc-9b3f-f9e4e21084db tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.382988 May 18 22:42:21.645143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 89/184] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:21 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:21.645696 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-aab9e849-5b58-4068-b94d-a94496898a32 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.385858 May 18 22:42:21.645696 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 96/185] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:21 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:21.649945 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:21.652657 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:21.659907 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:21.660370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:21.661222 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:21.661662 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:21.901041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:21.910266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-40c4ce05-67f4-4636-ba56-3e3a2e5d3cc1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.274117 May 18 22:42:21.911406 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 90/186] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:21 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:22.655344 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:22.656023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:22.657482 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:22.658114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:22.663319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:22.663773 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:22.664237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:22.664562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:22.664830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:22.665140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:22.665591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:22.666043 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:22.876675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:22.880285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:22.890058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1be7112c-46cc-4725-b9c4-2dd7ca166f51 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.238018 May 18 22:42:22.890221 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-09e28767-75f4-4a5b-a6b4-99c2357fd3fd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.236372 May 18 22:42:22.891371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 91/187] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:22 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:22.891848 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 97/188] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:22 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:22.927664 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:22.928269 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:22.934553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:22.935010 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:22.935763 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:22.936214 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:23.081212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:23.103654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3eecb890-4ea6-42a3-988a-d63647036c22 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.179786 May 18 22:42:23.115083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 92/189] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:22 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:23.654303 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-108d6d79-bb91-4f58-9836-408c29c443a2 req-46f488c7-0495-43d8-8d45-200fe40041a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70925c7e-8a38-4cd6-a8ff-7b66a613265c", "name": "network-vif-plugged", "status": "completed", "tag": "bf37ad73-6cb2-476c-b1e5-21bc440a86e1"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:23.673025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-108d6d79-bb91-4f58-9836-408c29c443a2 req-46f488c7-0495-43d8-8d45-200fe40041a1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:23.674077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-108d6d79-bb91-4f58-9836-408c29c443a2 req-46f488c7-0495-43d8-8d45-200fe40041a1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:23.692351 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-108d6d79-bb91-4f58-9836-408c29c443a2 req-46f488c7-0495-43d8-8d45-200fe40041a1 service nova] Creating event network-vif-plugged:bf37ad73-6cb2-476c-b1e5-21bc440a86e1 for instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c on hv-cinder-83800 May 18 22:42:23.703681 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-108d6d79-bb91-4f58-9836-408c29c443a2 req-46f488c7-0495-43d8-8d45-200fe40041a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210626 May 18 22:42:23.709237 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 98/190] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:42:23.921590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:23.928329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:23.928461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:23.928461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:23.938883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=79 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:23.944093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:23.944538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:23.945059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:23.945946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:23.947697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:23.948928 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:23.950125 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:23.950764 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:24.255190 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:24.259065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:24.262943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1f8729d3-57a5-4ffe-81b8-95393b260098 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.357504 May 18 22:42:24.263531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 99/191] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:23 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:24.267555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-058bf0b7-0b57-41e2-9338-9d787f71b175 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.362598 May 18 22:42:24.268308 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 93/192] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:23 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:24.269684 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:24.271674 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:24.276727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:24.277353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:24.278198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:24.278799 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:24.489647 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:24.499120 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-eddb95fb-010e-489a-8c3c-d49a36ba3ac4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.233743 May 18 22:42:24.501325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 100/193] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:24 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:25.282115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:25.282833 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:25.286582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:25.287192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:25.289509 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:25.290072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:25.290929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:25.291452 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:25.293255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:25.293694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:25.294966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:25.295567 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:25.500789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:25.514690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1e40279f-8a25-40f4-b4be-14bf1be103d3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.231388 May 18 22:42:25.526319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 101/194] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:25 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:25.536867 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:25.541208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:25.541830 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:25.549527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:25.550569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:25.551966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:25.554268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:25.560914 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:25.563851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-35ae53ed-2541-4d9c-9a23-48d76cb1398b tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.285969 May 18 22:42:25.564544 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 94/195] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:25 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:25.720953 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:25.729019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0238186c-1518-4f1c-8329-7cace2d8b605 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.200890 May 18 22:42:25.729596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 102/196] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:25 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:26.533101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:26.533897 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:26.540134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:26.540582 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:26.541400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:26.541991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:26.581533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:26.582812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:26.589463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:26.589904 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:26.590694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:26.591162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:26.763720 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:26.772075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-917251d0-dd2a-4274-b009-1736ad2f6d9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.243430 May 18 22:42:26.772858 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 95/197] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:26 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:26.777630 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:26.778464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:26.784569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:26.785214 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:26.786476 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:26.787334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:26.823135 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:26.830878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0bb5974f-231c-4aff-9f07-680cbe1da69a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.254012 May 18 22:42:26.831599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 103/198] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:26 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:26.927120 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:26.934830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-216185e2-90a1-4b62-850f-94938f4c66cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.160857 May 18 22:42:26.935932 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 96/199] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:26 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:27.789149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:27.790042 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:27.796619 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:27.797071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:27.799682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:27.799682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:27.851273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:27.852272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:27.861279 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:27.862317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:27.863353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:27.864079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:28.215064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:28.215064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c75ecf14-1c3d-44bc-bc9c-b7ab6ee49480 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.256529 May 18 22:42:28.215064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 104/200] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:27 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:28.215064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:28.217052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:28.217052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=80 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:28.217052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:28.217052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:28.218767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:28.218767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:28.219342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:28.219342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-438071a2-0051-4d83-bffe-cbe7ee142b88 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.222660 May 18 22:42:28.219342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 97/201] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:27 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:28.219997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:28.219997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f0811a59-0180-40a7-9a8d-2f585bc29455 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.158276 May 18 22:42:28.219997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 105/202] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:28 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:29.205802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:29.206424 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:29.206871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:29.206984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:29.214493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:29.215380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:29.216594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:29.217035 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:29.220358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:29.220814 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:29.221598 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:29.222080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:29.412526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:29.420449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0d34bd80-74fe-4189-9210-af571075d61a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.218501 May 18 22:42:29.421604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 98/203] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:29 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:29.430178 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:29.434344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:29.451201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:29.451654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:29.459093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:29.459093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:29.468355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:29.478327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-210afc8f-d668-4b09-bb8d-4f598253a751 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.280721 May 18 22:42:29.498445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 106/204] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:29 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:29.631199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:29.638771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd9e5e00-8b58-4e45-a118-0343dd19fea0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.212555 May 18 22:42:29.639329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 99/205] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:29 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:30.443092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:30.448688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:30.451900 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:30.452554 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:30.453686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:30.454181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:30.506829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:30.507612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:30.514237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:30.515317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:30.516109 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:30.516516 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:30.716156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:30.724143 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-23fe5423-4932-4a44-abd1-6fe93fa92a79 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.288391 May 18 22:42:30.724977 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 107/206] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:30 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:30.740213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:30.741051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:30.747300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:30.752261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:30.752261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:30.752261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:30.770032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:30.779038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6e2a1707-2a76-4e2c-a345-dfe16d1925b8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.276215 May 18 22:42:30.781171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 100/207] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:30 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:31.010424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:31.019419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1aea22a5-36c2-4d0f-904b-7294ca6381ef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.283314 May 18 22:42:31.029913 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 108/208] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:30 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:31.465323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-4748f8be-2330-4de7-8685-99a34178264f req-d4fbf58a-ea0d-4846-a61f-8ccc5af654e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da5b596-3bb2-490e-b163-0649fbbc2657", "name": "network-vif-plugged", "status": "completed", "tag": "fdb36b10-d6f4-4a5f-be73-d46b3a0b5721"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:31.475232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-4748f8be-2330-4de7-8685-99a34178264f req-d4fbf58a-ea0d-4846-a61f-8ccc5af654e5 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:31.475739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-4748f8be-2330-4de7-8685-99a34178264f req-d4fbf58a-ea0d-4846-a61f-8ccc5af654e5 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:31.487557 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-4748f8be-2330-4de7-8685-99a34178264f req-d4fbf58a-ea0d-4846-a61f-8ccc5af654e5 service nova] Creating event network-vif-plugged:fdb36b10-d6f4-4a5f-be73-d46b3a0b5721 for instance 5da5b596-3bb2-490e-b163-0649fbbc2657 on hv-cinder-83800 May 18 22:42:31.492983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-4748f8be-2330-4de7-8685-99a34178264f req-d4fbf58a-ea0d-4846-a61f-8ccc5af654e5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031256 May 18 22:42:31.493568 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 101/209] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:42:31.742609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:31.743243 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:31.750186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:31.750487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:31.751296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:31.751728 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:31.798925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:31.799706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:31.808067 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:31.808591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:31.809592 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:31.810187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:31.922529 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:31.930568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4f07bde9-f2e2-4e13-b076-3ba7ed307445 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.192400 May 18 22:42:31.931204 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 109/210] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:31 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:31.971658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:31.979041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-17242297-e713-4bd6-8139-b606590325ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.184803 May 18 22:42:31.988737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 102/211] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:31 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:32.036797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:32.043016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:32.050629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:32.051100 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:32.051863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:32.052291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:32.196922 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:32.206112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-585ccc51-80ef-4a66-a889-541cabfbc39c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.173033 May 18 22:42:32.206686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 110/212] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:32 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:32.950963 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:32.951566 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:32.960633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:32.960633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:32.964570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:32.965342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:32.971409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:32.996538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:32.997404 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:33.018254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:33.018722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:33.019769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:33.020295 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:33.170616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:33.178852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a212330b-6859-4a60-b149-9b0f8391d483 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.235107 May 18 22:42:33.179435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 103/213] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:32 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:33.200943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:33.209639 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f66c1d4e-f2a7-450c-89da-6e41652e251b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.216891 May 18 22:42:33.228319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 111/214] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:32 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:33.228599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:33.228599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:33.228987 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:33.229499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:33.230360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:33.230885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:33.386484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:33.396191 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-49419cef-bc7e-4196-abc4-da9d4555142d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.177670 May 18 22:42:33.396984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 104/215] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:33 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:34.195905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:34.196512 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:34.203159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:34.203516 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:34.204276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:34.204709 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:34.236968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:34.237420 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:34.245089 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:34.246326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:34.246820 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:34.247610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:34.439482 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:34.446403 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:34.449619 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1d7c6f4c-df59-499e-8a2b-7bb7fefb5933 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.257435 May 18 22:42:34.459746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 112/216] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:34 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:34.459746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:34.459746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:34.464559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e2c05065-7e0c-4de3-a603-b4d47fe9f8eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.231872 May 18 22:42:34.464559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 105/217] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:34 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:34.491384 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:34.491837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:34.492772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:34.493249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:34.649459 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:34.657643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-84115eda-3435-4a91-9e74-ef768080966d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.205694 May 18 22:42:34.658246 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 113/218] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:34 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:35.467232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:35.467894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:35.474295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:35.474743 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:35.475590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:35.476029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:35.480473 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:35.481079 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:35.487626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:35.488066 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:35.488831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:35.489256 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:35.676410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:35.679598 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:35.685934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1255f881-a4b0-4378-bd9e-9d9754e46ae6 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.222505 May 18 22:42:35.686641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 106/219] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:35 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:35.687269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f4641205-2a02-4db0-8b13-da7a52f99250 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.210653 May 18 22:42:35.688512 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 114/220] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:35 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:35.692514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:35.693223 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:35.699582 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:35.700099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:35.700936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:35.701439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:35.832904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:35.840213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-81424316-c826-4735-8c09-028155e92cb0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.151684 May 18 22:42:35.840773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 107/221] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:35 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:36.704980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:36.705594 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:36.708114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:36.709050 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:36.712870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:36.713316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:36.714117 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:36.714551 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:36.715187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:36.715631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:36.716381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:36.716805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:36.902248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:36.909979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-24f7a16e-0ca1-4116-868a-09ffb312a20a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.210101 May 18 22:42:36.910585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 115/222] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:36 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:36.913209 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:36.914937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:36.915533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:36.921380 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:36.922373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:36.923132 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:36.923323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0f4662e7-3cc2-4132-b5f7-56d6b75b0f07 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.221200 May 18 22:42:36.923559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:36.923905 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 108/223] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:36 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:37.061435 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:37.069801 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c285fc18-84c5-4095-9d6f-561b991a086a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.158248 May 18 22:42:37.070559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 116/224] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:36 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:37.926641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:37.927240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:37.933544 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:37.933996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:37.934813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:37.935247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:37.940178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:37.940775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:37.946732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:37.947171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:37.947945 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:37.948374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:38.135108 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:38.148036 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8f06c762-4051-4fee-82a7-4cbb744d0216 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.225233 May 18 22:42:38.157608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:38.158793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 109/225] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:37 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:38.163618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:38.164564 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:38.168242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-442881a0-1d60-4d3d-a233-1d05c8df0c6e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.232267 May 18 22:42:38.173230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:38.173674 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:38.175472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:38.175906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:38.178388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 117/226] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:37 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:38.304329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:38.311921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1541e30c-5dbc-4b55-b218-e38fc82669a3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.151938 May 18 22:42:38.312489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 110/227] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:38 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:39.164525 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:39.165160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:39.171321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.171791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.172764 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.173513 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.186512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:39.188927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:39.196192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.197211 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.198272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.199056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.383447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:39.386887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:39.391585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3979884e-a2f7-4982-a50f-fbf2eb42df6d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.230785 May 18 22:42:39.392385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 118/228] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:39 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:39.396792 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:39.397397 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:39.403626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.404310 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.405103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.405535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.412261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:39.420299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9e33bf1f-94f2-4e41-a71b-fe94f00e8d78 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.237987 May 18 22:42:39.421132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 111/229] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:39 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:39.496349 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-c7b5daea-d92c-484a-8276-5e28d9dc5c68 req-28b1e5f9-498a-4baf-b4c0-568811c98228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76212507-6655-4eae-b27d-239e5e349b46", "name": "network-vif-plugged", "status": "completed", "tag": "2ade8e46-0efa-484e-835b-4b4ce42c3411"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:39.506498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c7b5daea-d92c-484a-8276-5e28d9dc5c68 req-28b1e5f9-498a-4baf-b4c0-568811c98228 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:39.512235 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c7b5daea-d92c-484a-8276-5e28d9dc5c68 req-28b1e5f9-498a-4baf-b4c0-568811c98228 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:39.519570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-c7b5daea-d92c-484a-8276-5e28d9dc5c68 req-28b1e5f9-498a-4baf-b4c0-568811c98228 service nova] Creating event network-vif-plugged:2ade8e46-0efa-484e-835b-4b4ce42c3411 for instance 76212507-6655-4eae-b27d-239e5e349b46 on hv-cinder-83800 May 18 22:42:39.524584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-c7b5daea-d92c-484a-8276-5e28d9dc5c68 req-28b1e5f9-498a-4baf-b4c0-568811c98228 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 May 18 22:42:39.525297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 112/230] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:42:39.552045 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:39.560930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f723b500-0658-4dab-975e-8f47dc451e0c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.167684 May 18 22:42:39.561515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 119/231] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:39 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:40.409237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:40.413256 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:40.417991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:40.418473 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:40.419229 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:40.419656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:40.444633 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:40.445365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:40.453173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:40.454316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:40.455377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:40.456020 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:40.631214 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:40.638697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1e32959a-7014-4ebb-9af1-5b718a764f22 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.233883 May 18 22:42:40.639276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 113/232] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:40 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:40.644163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:40.644902 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:40.645718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:40.652104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:40.652552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:40.653321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:40.653589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3bd96f1e-c806-4950-9f3e-2f9ccbfad70b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.212750 May 18 22:42:40.653795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:40.665661 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 120/233] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:40 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:40.926853 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:40.934487 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-279ef58a-be7a-4f80-a14e-feb3393118f7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.294265 May 18 22:42:40.935059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 114/234] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:40 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:41.655904 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:41.656666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:41.662649 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:41.663096 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:41.663884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:41.664316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:41.671841 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:41.673309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:41.679577 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:41.680288 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:41.681058 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:41.681497 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:42.041962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:42.051159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-30f3c34c-2079-451f-8049-a7bad93acd72 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.398993 May 18 22:42:42.051737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 121/235] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:41 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:42.054515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:42.057273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:42.057869 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:42.064581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c4b5c5fe-9819-43d8-802c-2ddfa076ccd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.396997 May 18 22:42:42.065244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 115/236] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:41 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:42.071822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:42.071822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:42.071822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:42.071822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:42.196489 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:42.204102 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-090d4d03-e812-43da-9cdd-90cbc7744d8c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.151424 May 18 22:42:42.204676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 122/237] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:42 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:43.068484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:43.069115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:43.075153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:43.075593 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:43.076346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:43.076777 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:43.081434 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:43.082052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:43.087959 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:43.088396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:43.089144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:43.089571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:43.274136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:43.278049 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:43.281594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6f062426-3919-4513-95ea-d2baa648c63a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.216985 May 18 22:42:43.282600 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 116/238] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:43 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:43.285864 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c7956ea0-ef55-4418-a680-af25ee74ecae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.208966 May 18 22:42:43.286609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 123/239] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:43 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:43.286862 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:43.287455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:43.293310 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:43.293751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:43.294530 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:43.294959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:43.426820 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:43.434536 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-605b4c53-1774-4d33-a075-3683084f3b49 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.150994 May 18 22:42:43.435027 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 117/240] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:43 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:44.299996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:44.300655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:44.303202 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:44.303804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:44.306947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:44.307392 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:44.308154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:44.308583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:44.310262 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:44.310702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:44.311446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:44.311866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:44.498368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:44.505851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:44.506660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-bc83daf5-6b5c-48b2-ba18-c0f69f28747f tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.211357 May 18 22:42:44.507348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 124/241] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:44 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:44.511697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:44.512297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:44.514291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-38cec888-03da-4935-a8ff-74d671c743f0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.214782 May 18 22:42:44.515188 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 118/242] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:44 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:44.519562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:44.521211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:44.521211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:44.521211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:44.786711 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:44.794335 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9b900fbf-3a0c-4da9-bd4f-22c09f0f8b5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.286016 May 18 22:42:44.794885 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 125/243] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:44 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:45.523456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:45.524064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:45.530250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:45.530699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:45.532199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:45.532625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:45.538328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:45.539226 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:45.545441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:45.546147 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:45.547924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:45.548556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:45.736250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:45.740227 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:45.743643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-33bcc41d-81c7-4211-a093-5831bdf34f13 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1315 microversion: 2.1 time: 0.223925 May 18 22:42:45.744212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 119/244] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:45 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:45.747501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-862dc6dd-be44-4f03-ad0d-edd08313e7c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.214073 May 18 22:42:45.748053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 126/245] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:45 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:45.811390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:45.811988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:45.818243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:45.818687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:45.819447 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:45.819877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:45.839165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:45.948277 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:45.956826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b8c0008b-03ad-4c6a-9ec7-948c64df8418 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.149283 May 18 22:42:45.957387 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 120/246] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:45 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:46.760422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:46.761190 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:46.764782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:46.765390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:46.767342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:46.767785 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:46.768545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:46.768970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:46.771852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:46.772299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:46.773062 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:46.773501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:46.977932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:46.981219 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:46.989716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9f708c28-5b7c-4ad3-976c-9e2f6a185ac8 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1503 microversion: 2.1 time: 0.232735 May 18 22:42:46.989977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9da3af55-bd8d-484e-8b3e-2265e6956791 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.229374 May 18 22:42:46.999700 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 121/247] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:46 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:46.999978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 127/248] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:46 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:47.000724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:47.001917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:47.008843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:47.009273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:47.010066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:47.010619 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:47.159415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:47.167383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-46ea1bc7-85be-4d7d-bd2a-ae414e2d2f7f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.175130 May 18 22:42:47.168278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 122/249] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:46 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:48.006757 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:48.007359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:48.013410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:48.013853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:48.014678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:48.015133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:48.149574 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:48.165404 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-15e456b0-3f72-4cf9-8493-ffdbd611f073 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.162534 May 18 22:42:48.170663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 128/250] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:48 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:48.184766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:48.185365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:48.192060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:48.192500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:48.196465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:48.196465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:48.322716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:48.330529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-06d2825d-d90f-4a77-9556-fc06e907c84a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.149443 May 18 22:42:48.331072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 123/251] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:48 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:49.183492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:49.184099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:49.190546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:49.190990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:49.191775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:49.192205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:49.322942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:49.330903 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4662b35d-f74d-4f89-b960-0654b3b0e85c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.151553 May 18 22:42:49.331462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 129/252] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:49 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:49.346949 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:49.347559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:49.353458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:49.354100 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:49.354716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:49.355149 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:49.481210 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:49.488780 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d2f7f6e6-4044-409c-aace-202e9dba307e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.146192 May 18 22:42:49.489522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 124/253] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:49 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:50.348111 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:50.348723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:50.354727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:50.355171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:50.355926 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:50.356359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:50.487409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:50.494824 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-332f0a88-b0b2-4f38-8451-1c1246e13ddf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.150706 May 18 22:42:50.495384 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 130/254] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:50 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:50.506726 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:50.507328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:50.513356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:50.513801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:50.514589 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:50.515020 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:50.642672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:50.650352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bef1e669-990a-457e-8c01-c26ab405c705 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.147406 May 18 22:42:50.650921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 125/255] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:50 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:51.512551 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:51.513183 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:51.519827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:51.520314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:51.521068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:51.521495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:51.662600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:51.667240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:51.668280 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:51.670832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-edfb6043-115d-41e5-b115-cdec511d884e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.162168 May 18 22:42:51.671412 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 131/256] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:51 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:51.674703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:51.675153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:51.675924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:51.676360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:51.805135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:51.812822 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4e4b3b8a-d8be-4e3f-8947-9e58699c2a90 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.149287 May 18 22:42:51.813406 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 126/257] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:51 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:52.689314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:52.690015 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:52.696134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:52.696580 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:52.697338 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:52.698161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:52.826452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:52.828780 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:52.830314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:52.834208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-170134c1-a417-4d7f-a7d5-09f8483eb0f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.149375 May 18 22:42:52.835343 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 132/258] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:52 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:52.836279 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:52.836855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:52.837626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:52.838244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:52.974278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:52.981547 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f7a27dc8-6360-4148-bcb5-38deb033c388 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.156540 May 18 22:42:52.982127 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 127/259] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:52 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:53.851807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:53.852378 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:53.858414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:53.858853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:53.859599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:53.860026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:53.990856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:53.998263 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5976394b-95fe-46c7-9209-e39b9b09b8ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.150300 May 18 22:42:53.998967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:53.999440 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 133/260] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:53 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:53.999521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:54.006484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:54.006933 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:54.007699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:54.008138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:54.138929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:54.146617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ceee9721-f207-4a19-9cd5-7e7bd62a4946 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.151635 May 18 22:42:54.147289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 128/261] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:53 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:55.015339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:55.015898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:55.021858 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:55.022326 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:55.023079 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:55.023503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:55.153203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:55.161557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8149687e-545c-4169-9e58-1bb4da5f427c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.149918 May 18 22:42:55.162244 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 134/262] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:55 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:55.165151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:55.165907 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:55.171941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:55.172383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:55.173823 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:55.174282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:55.306755 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:55.314689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7f5d4f12-38d6-420d-83b2-e4ee08129923 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.153421 May 18 22:42:55.315451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 129/263] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:55 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:56.186369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:56.186982 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:56.194022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:56.194489 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:56.195266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:56.195696 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:56.213546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:56.326297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:56.331713 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:56.332333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:56.333702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-03ef37dc-039d-4a15-ae0f-d1cddc2c14c4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.151190 May 18 22:42:56.334479 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 135/264] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:56 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:56.335445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=74 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:56.338901 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:56.339350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:56.340114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:56.340553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:56.469948 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:56.478081 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c1a15bea-a798-4692-9c90-c7677c8e2a12 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.149777 May 18 22:42:56.481338 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 130/265] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:56 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:57.350989 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:57.351593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:57.357508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:57.358012 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:57.358754 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:57.359187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:57.494604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:57.495740 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:57.503152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:57.503606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:57.503747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:57.504380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:57.504822 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:57.512463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dba7d1b3-0e37-4fa5-ba3d-ed723e67631d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.165118 May 18 22:42:57.513107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 136/266] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:57 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:57.518095 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-62e84d66-a3ff-481c-90d8-bcf089229d94 req-ffc11209-12de-49ac-b25e-5c3167dd7cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097a1c9f-e116-4327-a473-ab82fe379d7f", "name": "network-vif-plugged", "status": "completed", "tag": "d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:57.526166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-62e84d66-a3ff-481c-90d8-bcf089229d94 req-ffc11209-12de-49ac-b25e-5c3167dd7cc1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:57.526602 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-62e84d66-a3ff-481c-90d8-bcf089229d94 req-ffc11209-12de-49ac-b25e-5c3167dd7cc1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:57.537398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-62e84d66-a3ff-481c-90d8-bcf089229d94 req-ffc11209-12de-49ac-b25e-5c3167dd7cc1 service nova] Creating event network-vif-plugged:d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7 for instance 097a1c9f-e116-4327-a473-ab82fe379d7f on hv-cinder-83800 May 18 22:42:57.542753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-62e84d66-a3ff-481c-90d8-bcf089229d94 req-ffc11209-12de-49ac-b25e-5c3167dd7cc1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028543 May 18 22:42:57.543447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 137/267] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:42:57.650500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:57.658587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ee7fec26-b060-4e8d-ac31-01844f497add tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.167868 May 18 22:42:57.659149 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 131/268] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:57 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:58.530599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:58.531299 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:58.537661 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:58.538370 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:58.539422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:58.540052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:58.675323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:58.675933 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:58.682302 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:58.682991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:58.683946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:58.684591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:58.696105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:58.705758 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ad805a24-3a65-4f11-a2f7-4a84f8a2038e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.179577 May 18 22:42:58.715385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 138/269] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:58 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:42:58.819067 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:58.826526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-56805a22-82f0-4d11-b80a-5de7e24fbfb9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.155397 May 18 22:42:58.827092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 132/270] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:58 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:59.385870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "239b0887-7d65-498c-811e-f19ec0dedbd5"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:42:59.386991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:59.389150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=68 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:42:59.394426 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:59.394867 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:59.395743 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:59.396220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:59.723243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:59.724000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:59.730080 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:59.730524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:59.731284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:59.731717 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:59.870874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:42:59.878657 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-92604c4e-40f4-4fe0-b102-af00af9d7024 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.159559 May 18 22:42:59.879238 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 133/271] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:59 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:42:59.883996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:42:59.884809 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:42:59.893073 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:59.893524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:42:59.894359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:42:59.894852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:00.031781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:00.040652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c0b444e7-d375-47ce-ab2a-42c776317eaa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.160214 May 18 22:43:00.041230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 134/272] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:42:59 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:00.896470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:00.897151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:00.903198 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:00.903641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:00.904388 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:00.904816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:01.042363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:01.047693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a967dcfc-d32e-4f3f-8696-b4eb7d284866 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.154754 May 18 22:43:01.057083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 135/273] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:00 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:01.057083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:01.057604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:01.064135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:01.064591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:01.065445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:01.065792 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:01.196223 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:01.205057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a415a258-3ba9-4e0c-a21c-0312dc16f3df tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.152435 May 18 22:43:01.205834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 136/274] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:01 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:02.064287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:02.064894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:02.070988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:02.073952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:02.073952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:02.073952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:02.076522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:02.205034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:02.212596 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-58b18332-27d4-4d9f-b795-92b987ae6038 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.152294 May 18 22:43:02.213170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 137/275] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:02 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:02.220829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:02.221483 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:02.227460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:02.227909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:02.228785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:02.229735 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:02.363859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:02.369742 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2b7f4825-facd-4e20-95b8-a8e9cae71480 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.152825 May 18 22:43:02.370335 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 138/276] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:02 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:03.229564 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:03.230192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:03.236970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:03.237425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:03.238203 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:03.238640 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:03.366227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:03.373763 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-33d4589c-8da5-4c10-bdbb-3ec5661a82d4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.147959 May 18 22:43:03.374366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 139/277] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:03 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:03.386285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:03.386883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:03.392626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:03.393065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:03.393814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:03.394278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:03.533708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:03.541783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d0c970a9-aaa2-4d2f-b314-d21e26ca0e07 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1322 microversion: 2.1 time: 0.159034 May 18 22:43:03.542501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 140/278] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:03 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:04.390919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:04.391562 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:04.397774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:04.398353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:04.399129 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:04.399576 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:04.528361 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:04.536062 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3dac7935-f04b-4912-a1e6-95cd5fa7e46c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.149054 May 18 22:43:04.536643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 141/279] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:04 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:04.559192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:04.559796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:04.566465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:04.566913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:04.567676 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:04.568111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:04.700674 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:04.710721 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-257fe7a6-e380-4d22-b687-429f695a0328 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1516 microversion: 2.1 time: 0.155096 May 18 22:43:04.711350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 142/280] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:04 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:04.731371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:04.732372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:04.739697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:04.740301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:04.741132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:04.741630 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:04.806064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'flavor' on Instance uuid 76212507-6655-4eae-b27d-239e5e349b46 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:43:04.884680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6c2d889d-5881-4807-bf2d-4fee410def6a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "POST /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.502563 May 18 22:43:04.885621 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 139/281] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:42:59 2022] POST /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c/os-volume_attachments => generated 194 bytes in 5504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:43:05.135287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f9b24972-bc82-4cef-8c01-862758bdf729 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46/action" status: 200 len: 32 microversion: 2.1 time: 0.408054 May 18 22:43:05.135913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 143/282] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:43:04 2022] POST /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 22:43:05.147219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:05.147758 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:05.154189 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:05.154634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:05.155396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:05.155822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:05.288771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:05.296482 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2e6340b4-9437-462a-83c1-634171d80175 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.153618 May 18 22:43:05.297053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 140/283] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:05 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:05.554182 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:05.555137 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:05.561419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:05.561875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:05.562669 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:05.563102 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:05.692742 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:05.700197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-56173f30-ddd0-494a-97ea-69bc3ac2568a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1368 microversion: 2.1 time: 0.151349 May 18 22:43:05.700767 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 144/284] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:05 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:06.314371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:06.316535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:06.325978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:06.326456 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:06.327641 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:06.328085 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:06.474116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:06.481558 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-923683e5-fa0f-4c27-84b8-cf0e26e6b179 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.171023 May 18 22:43:06.482171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 141/285] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:06 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:06.716635 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:06.717409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:06.724107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:06.724490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:06.725252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:06.725689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:06.854117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:06.862861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ed8356de-359b-424a-8ab8-c4e3d6bc97ae tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1558 microversion: 2.1 time: 0.150009 May 18 22:43:06.863426 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 145/286] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:06 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:06.881056 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:06.881420 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:06.887367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:06.887808 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:06.888611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:06.889039 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:06.966586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6fda23a2-d476-43a4-9853-1a4629910f66 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090381 May 18 22:43:06.967316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 142/287] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:43:06 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:43:07.499320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:07.499937 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:07.508189 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:07.515248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:07.515248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:07.515248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:07.869886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:07.877897 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f345c4d7-1f0a-4036-8cdf-3ef4f7ed19e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.382725 May 18 22:43:07.878500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 146/288] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:07 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:08.467751 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-80803398-86e3-4f7f-a7e7-424dbc158fae req-617c84c2-e0a8-4e5a-93b1-ebd31470d788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "097a1c9f-e116-4327-a473-ab82fe379d7f", "tag": "d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:08.479720 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-80803398-86e3-4f7f-a7e7-424dbc158fae req-617c84c2-e0a8-4e5a-93b1-ebd31470d788 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:08.480166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-80803398-86e3-4f7f-a7e7-424dbc158fae req-617c84c2-e0a8-4e5a-93b1-ebd31470d788 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:08.492428 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-80803398-86e3-4f7f-a7e7-424dbc158fae req-617c84c2-e0a8-4e5a-93b1-ebd31470d788 service nova] Creating event network-changed:d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7 for instance 097a1c9f-e116-4327-a473-ab82fe379d7f on hv-cinder-83800 May 18 22:43:08.498750 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-80803398-86e3-4f7f-a7e7-424dbc158fae req-617c84c2-e0a8-4e5a-93b1-ebd31470d788 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 May 18 22:43:08.504212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 143/289] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:43:08.895804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:08.896412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:08.903104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:08.903561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:08.905807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:08.905807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:09.125784 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:09.137694 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a010f7e-3b6d-49e1-935c-65d2351b7d29 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.246063 May 18 22:43:09.139850 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 147/290] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:08 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:10.157198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:10.159354 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:10.168660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:10.168660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:10.168660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:10.170548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:10.309199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:10.317549 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c53dd31b-552d-4cea-a402-60590743c3f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.165217 May 18 22:43:10.318141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 144/291] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:10 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:11.333852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:11.334497 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:11.341001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:11.341457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:11.342573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:11.344222 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:11.480562 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:11.491591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8d5d91dd-04ff-456b-9d59-578d522cdc06 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.160384 May 18 22:43:11.491591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 148/292] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:11 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:12.506573 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:12.507441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:12.513986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:12.514888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:12.515485 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:12.516026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:12.667028 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:12.674878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0cbbc3ff-f044-481c-861c-33f7df0863e9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.172230 May 18 22:43:12.675588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 145/293] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:12 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:13.693527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:13.694781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:13.701532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:13.701988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:13.702824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:13.703289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:13.833518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:13.841467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d3d87e79-d196-445d-afc6-80673acd45b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.153182 May 18 22:43:13.842096 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 149/294] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:13 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:14.858640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:14.859236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:14.865809 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:14.866283 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:14.867034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:14.867465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:15.001727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:15.009779 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5de2d0e9-3c27-4439-b4f7-0358dcf3695b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.154960 May 18 22:43:15.010386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 146/295] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:14 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:16.027746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:16.028350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:16.035063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:16.035990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:16.036768 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:16.037201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:16.167985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:16.176327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ac6080c6-a617-4b8d-86c6-3cc6f41ade05 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.152225 May 18 22:43:16.176894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 150/296] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:16 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:17.193902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:17.194530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:17.201182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:17.201657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:17.202452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:17.203061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:17.385252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:17.392834 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-99c8a51b-ee53-4673-b882-22c9ec8674d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.203448 May 18 22:43:17.401634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 147/297] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:17 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:18.410868 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:18.412168 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:18.418442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:18.419107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:18.420035 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:18.420934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:18.569046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:18.573032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:18.578171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4a890d7f-1196-4e87-a604-7f2257694188 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.171702 May 18 22:43:18.588918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 151/298] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:18 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:19.596618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:19.599064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:19.607678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:19.608130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:19.613368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:19.613368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:19.755859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:19.757353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:19.768293 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:19.769896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:19.770553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:19.771560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:19.772179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:19.778325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ce09d79b-24bd-4d17-9427-2b5c93647f8b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.184937 May 18 22:43:19.787491 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 148/299] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:19 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:19.815322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:43:20.090493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5e469083-e645-485c-87b4-a2371b1dc4c9 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "DELETE /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 204 len: 0 microversion: 2.1 time: 0.339817 May 18 22:43:20.091024 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 152/300] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:43:19 2022] DELETE /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:43:20.099541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:20.100236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:20.106317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:20.106768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:20.107535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:20.108405 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:20.250817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:20.260091 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6ed816b3-5532-4d0a-8fa0-5c0b8f0930a4 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.164601 May 18 22:43:20.260994 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 149/301] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:20 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:20.795013 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:20.795714 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:20.803125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:20.803580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:20.804653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:20.805090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:20.944979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:20.952935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bfd6406d-0eb5-4d85-be69-c5d0dec45a86 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.162142 May 18 22:43:20.953922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 153/302] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:20 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:21.276631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:21.277252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:21.283718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:21.284161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:21.285095 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:21.285643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:21.595605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:21.604282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8d5dab7f-f401-4de2-9a68-06abc778d556 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.331434 May 18 22:43:21.604852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 150/303] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:21 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:21.970807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:21.971451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:21.980286 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:21.980730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:21.981499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:21.981930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:22.169310 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:22.190799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e43b5fe5-117a-4ebb-b150-194815b3b74e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.223856 May 18 22:43:22.194639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 154/304] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:21 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:22.622058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:22.623200 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:22.629800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:22.630276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:22.631031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:22.631455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:22.759417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:22.767317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c0cd31b1-5b28-4771-9527-bae0b4b3302d tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.149103 May 18 22:43:22.767872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 151/305] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:22 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:23.211350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:23.211963 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:23.217978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:23.218457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:23.219237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:23.219677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:23.354301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:23.361764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9bf8f72e-04cc-43ce-9c82-0b26769b5c91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.154287 May 18 22:43:23.362353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 155/306] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:23 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:23.783989 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:23.784716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:23.791274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:23.791726 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:23.794765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:23.794765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:23.811786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:23.929571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:23.938207 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5889fc06-4f05-4288-8b9a-d90f5256c4f5 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.158024 May 18 22:43:23.938855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 152/307] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:23 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:24.379062 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:24.379710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:24.385648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:24.386130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:24.386906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:24.387329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:24.520532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:24.527973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-95909420-5e82-4bfc-bb1f-bf6dc44a062b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.152853 May 18 22:43:24.528533 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 156/308] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:24 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:24.956822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:24.957523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:24.965053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:24.965577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:24.966617 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:24.967064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:25.103257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:25.111258 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c1d2f80f-0fab-4ee4-9c3c-025d57e4042a tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.159187 May 18 22:43:25.111827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 153/309] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:24 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:25.545384 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:25.545958 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:25.552497 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:25.552943 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:25.553705 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:25.554445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:25.691563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:25.699368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5de17fea-db1b-4466-8d7e-b00ee714da2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.157858 May 18 22:43:25.699948 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 157/310] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:25 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:26.128636 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:26.129353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:26.136664 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:26.137176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:26.138105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:26.138597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:26.271373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:26.279257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3cddf107-d3ba-4337-826d-ccb94b5b8013 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.154627 May 18 22:43:26.279788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 154/311] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:26 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:26.716653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:26.717247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:26.719347 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:26.724313 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:26.724757 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:26.725517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:26.725948 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:26.865195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:26.871954 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3de86bb7-8b6d-49c0-b618-e30b30369bd8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.159298 May 18 22:43:26.881502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 158/312] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:26 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:27.296816 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:27.297358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:27.304016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:27.304731 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:27.305502 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:27.305937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:27.448491 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:27.457630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9ff4913a-9e91-4fca-9a39-1396f8c3aae1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1555 microversion: 2.1 time: 0.164671 May 18 22:43:27.458251 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 155/313] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:27 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:27.889060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:27.889899 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:27.905835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:27.905835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:27.905835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:27.905835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:28.136794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:28.152375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e440e075-2ace-4564-aec2-8798db6993da tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.267591 May 18 22:43:28.153639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 159/314] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:27 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:28.437232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-2fef4194-e0ad-42d4-a8ee-051b508df7f4 req-4f1505c5-8264-4528-a874-baa55e6bd7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70925c7e-8a38-4cd6-a8ff-7b66a613265c", "name": "network-vif-deleted", "tag": "bf37ad73-6cb2-476c-b1e5-21bc440a86e1"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:28.448078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2fef4194-e0ad-42d4-a8ee-051b508df7f4 req-4f1505c5-8264-4528-a874-baa55e6bd7f9 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:28.448592 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2fef4194-e0ad-42d4-a8ee-051b508df7f4 req-4f1505c5-8264-4528-a874-baa55e6bd7f9 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:28.462313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-2fef4194-e0ad-42d4-a8ee-051b508df7f4 req-4f1505c5-8264-4528-a874-baa55e6bd7f9 service nova] Creating event network-vif-deleted:bf37ad73-6cb2-476c-b1e5-21bc440a86e1 for instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c on hv-cinder-83800 May 18 22:43:28.467700 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-2fef4194-e0ad-42d4-a8ee-051b508df7f4 req-4f1505c5-8264-4528-a874-baa55e6bd7f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033982 May 18 22:43:28.470522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 156/315] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:43:28.476618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:28.477597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:28.483813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:28.484415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:28.489615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:28.489615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:28.559968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:28.575527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-34802f8c-5f54-4494-9ecd-0caaceb5132e tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1513 microversion: 2.1 time: 0.100597 May 18 22:43:28.575527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 160/316] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:28 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1513 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:29.171183 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:29.171888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:29.178751 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:29.179462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:29.180238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:29.180702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:29.313811 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:29.322119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e9b913d9-3ac5-4571-8a9c-dc11db859e93 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.155726 May 18 22:43:29.322658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 157/317] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:29 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:29.591700 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:29.592208 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:29.598433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:29.598887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:29.599656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:29.600087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:29.669662 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:29.678374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b9a37692-e327-4d42-b2f7-28b2e2882ff1 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1346 microversion: 2.1 time: 0.090546 May 18 22:43:29.678935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 161/318] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:29 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:30.339682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:30.340275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:30.342400 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=38 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:30.348154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:30.348154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:30.348712 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:30.349208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:30.525423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:30.543787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-72ee405b-8dff-44d7-8c90-262aa9b5d609 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.201724 May 18 22:43:30.543787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 158/319] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:30 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:30.695846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:30.696459 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:30.702531 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:30.702977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:30.703824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:30.704263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:30.739948 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:30.740391 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:30.740838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lazy-loading 'fault' on Instance uuid 70925c7e-8a38-4cd6-a8ff-7b66a613265c {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:43:30.788929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270785984bc645ec899aeb22a8f9054f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60b6521267447fe8b4c12f701a40144', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:30.797453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0322a137-6bdd-4934-afa1-61170f49d758 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 200 len: 1351 microversion: 2.1 time: 0.105438 May 18 22:43:30.798413 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 162/320] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:30 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 1351 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:31.555130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:31.555820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:31.563606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:31.564590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:31.564985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:31.565507 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:31.773686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:31.782840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-28e70161-9a32-492c-919d-ce43c3817aea tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.232807 May 18 22:43:31.783417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 159/321] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:31 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:31.816197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:31.816197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:31.824294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:31.824868 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:31.825947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:31.827977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:31.845252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] HTTP exception thrown: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Request method failure captured: May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c HTTP/1.1 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYWf36Sh0t6qPcvbvjwCFngjXsoNwTgFCLtYNnzYDS9cwBlyxEZ1LE1Ui5_2ACO9bPe8jUKObqo3jDXva3Scxf7zYxfrLvgqHlR0KlakEJyQWfcqj80a96Z_M5mZIJydeRz3lzQJaNaOFTJYk6wyX8oHpVUBtkbCxMiUdakM_okWI0 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:43:31.850642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f60b6521267447fe8b4c12f701a40144", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f60b6521267447fe8b4c12f701a40144"}]}] May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 270785984bc645ec899aeb22a8f9054f May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:31.852273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '70925c7e-8a38-4cd6-a8ff-7b66a613265c'} May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:43:31.853115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:31.854696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:31.855913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Returning 404 to user: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:43:31.855913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-030c181b-a712-4821-a07d-3200583edf61 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 404 len: 111 microversion: 2.1 time: 0.041243 May 18 22:43:31.855913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 163/322] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:31 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:43:32.108454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:32.109365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:32.115740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:32.116361 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:32.117331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:32.117764 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:32.131453 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] HTTP exception thrown: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Request method failure captured: May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c/os-volume_attachments HTTP/1.1 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYWf36Sh0t6qPcvbvjwCFngjXsoNwTgFCLtYNnzYDS9cwBlyxEZ1LE1Ui5_2ACO9bPe8jUKObqo3jDXva3Scxf7zYxfrLvgqHlR0KlakEJyQWfcqj80a96Z_M5mZIJydeRz3lzQJaNaOFTJYk6wyX8oHpVUBtkbCxMiUdakM_okWI0 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:43:32.135941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f60b6521267447fe8b4c12f701a40144", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f60b6521267447fe8b4c12f701a40144"}]}] May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 270785984bc645ec899aeb22a8f9054f May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:32.137220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'server_id': '70925c7e-8a38-4cd6-a8ff-7b66a613265c'} May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:43:32.137927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:32.139072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:32.140297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Returning 404 to user: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:43:32.140297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-af78006f-395b-4b44-bffe-990afda0f800 tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032963 May 18 22:43:32.140297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 160/323] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:43:32 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:43:32.800880 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:32.801569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:32.809925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:32.811083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:32.812521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:32.813271 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:32.969314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:32.986487 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-18e7d2fc-7bb2-4db8-a61a-41afea3e2be5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.188957 May 18 22:43:32.987064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 164/324] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:32 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:34.004675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:34.005331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:34.013874 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:34.014540 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:34.015410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:34.015915 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:34.193175 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:34.201082 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-72807063-0ba7-4e68-9094-4ba73e14d7e8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.201552 May 18 22:43:34.202586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 161/325] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:33 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:34.583807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:34.586163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:34.610368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:34.610936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:34.611772 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:34.613011 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:34.637578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] HTTP exception thrown: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Request method failure captured: May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c HTTP/1.1 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYWf36Sh0t6qPcvbvjwCFngjXsoNwTgFCLtYNnzYDS9cwBlyxEZ1LE1Ui5_2ACO9bPe8jUKObqo3jDXva3Scxf7zYxfrLvgqHlR0KlakEJyQWfcqj80a96Z_M5mZIJydeRz3lzQJaNaOFTJYk6wyX8oHpVUBtkbCxMiUdakM_okWI0 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:43:34.639383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f60b6521267447fe8b4c12f701a40144", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f60b6521267447fe8b4c12f701a40144"}]}] May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 270785984bc645ec899aeb22a8f9054f May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.641130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '70925c7e-8a38-4cd6-a8ff-7b66a613265c'} May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:43:34.642046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.644075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:43:34.647120 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Returning 404 to user: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:43:34.648263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5135526b-0a85-4864-ad4c-df594cb92e5c tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "DELETE /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 404 len: 111 microversion: 2.1 time: 0.068381 May 18 22:43:34.649413 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 165/326] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:43:34 2022] DELETE /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:43:34.658614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:34.666125 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] [instance: 70925c7e-8a38-4cd6-a8ff-7b66a613265c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:34.666125 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:34.666768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:34.667551 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:34.668535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] HTTP exception thrown: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Request method failure captured: May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c HTTP/1.1 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYWf36Sh0t6qPcvbvjwCFngjXsoNwTgFCLtYNnzYDS9cwBlyxEZ1LE1Ui5_2ACO9bPe8jUKObqo3jDXva3Scxf7zYxfrLvgqHlR0KlakEJyQWfcqj80a96Z_M5mZIJydeRz3lzQJaNaOFTJYk6wyX8oHpVUBtkbCxMiUdakM_okWI0 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:43:34.686472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f60b6521267447fe8b4c12f701a40144", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f60b6521267447fe8b4c12f701a40144"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f60b6521267447fe8b4c12f701a40144"}]}] May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: f60b6521267447fe8b4c12f701a40144 May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-DeleteServersTestJSON-1649209039 May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 270785984bc645ec899aeb22a8f9054f May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-DeleteServersTestJSON-1649209039-project May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.688107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '70925c7e-8a38-4cd6-a8ff-7b66a613265c'} May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:43:34.689152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. May 18 22:43:34.691495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:43:34.693423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] Returning 404 to user: Instance 70925c7e-8a38-4cd6-a8ff-7b66a613265c could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:43:34.693423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c749b939-468f-42ae-8b60-23f29ff0b2da tempest-DeleteServersTestJSON-1649209039 tempest-DeleteServersTestJSON-1649209039-project] 10.222.0.70 "GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c" status: 404 len: 111 microversion: 2.1 time: 0.034640 May 18 22:43:34.693423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 162/327] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:34 2022] GET /compute/v2.1/servers/70925c7e-8a38-4cd6-a8ff-7b66a613265c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:43:35.218973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:35.219772 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:35.228003 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:35.228664 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:35.229875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:35.230542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:35.388535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:35.397909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-11bce320-3b84-4b64-964b-ae9b5c1439a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.183028 May 18 22:43:35.398775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 166/328] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:35 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:36.415146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:36.415760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:36.422478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:36.425313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:36.425313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:36.425313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:36.567685 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:36.575145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-53ce2d24-3ed1-4491-8d48-171495dfd718 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.163815 May 18 22:43:36.575709 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 163/329] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:36 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:37.045418 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1663850593", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:37.104801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] validate_networks() for None {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:43:37.413248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:43:37.414126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:43:37.421594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:43:37.421594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:43:37.421594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:43:37.427509 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:37.427959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:37.429106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:37.429538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:37.452836 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Getting quotas for project 722f661c6312401b855c408a84d87639. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:43:37.457671 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Getting quotas for user bd1e0f88dc7f4eb494dea5d9af86a5f9 and project 722f661c6312401b855c408a84d87639. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:43:37.469014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:43:37.471488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:43:37.594548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:37.595281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:37.601791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:37.602286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:37.603556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:37.604217 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:37.632289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c1152fb-e68f-42af-872b-84415c5feb73 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590772 May 18 22:43:37.638402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 167/330] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:43:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 22:43:37.651225 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-67ad2faa-fc91-4f2d-9196-21adc218ee7c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:37.653150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-67ad2faa-fc91-4f2d-9196-21adc218ee7c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:37.768581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-67ad2faa-fc91-4f2d-9196-21adc218ee7c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:37.782833 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-67ad2faa-fc91-4f2d-9196-21adc218ee7c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1215 microversion: 2.1 time: 0.135394 May 18 22:43:37.792017 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:37.794244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 168/331] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:37 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:37.801102 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e3c6d31e-3431-43b9-a1c2-dac933a6a674 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.210266 May 18 22:43:37.801796 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 164/332] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:37 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:38.800895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c2ddaed5-92a4-49fe-b651-bf4fa1cca7b6 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:38.801808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c2ddaed5-92a4-49fe-b651-bf4fa1cca7b6 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:38.823074 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:38.823667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:38.835470 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:38.835930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:38.836721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:38.837163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:38.896401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c2ddaed5-92a4-49fe-b651-bf4fa1cca7b6 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:38.904123 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c2ddaed5-92a4-49fe-b651-bf4fa1cca7b6 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1215 microversion: 2.1 time: 0.107883 May 18 22:43:38.904737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 169/333] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:38 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:39.045141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:39.052596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0b7bbf41-d06c-43bd-b19b-d633a2968189 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.233319 May 18 22:43:39.053157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 165/334] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:38 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:39.926625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:39.927247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:39.948271 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:39.951733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:39.958041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:39.962291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:39.999476 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:40.070416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:40.070416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:40.076095 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:40.076582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:40.077359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:40.077968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:40.079796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:40.090151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c9074b1e-5484-4423-bc4c-bd0b75d4ed45 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1219 microversion: 2.1 time: 0.171026 May 18 22:43:40.090740 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 170/335] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:39 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1219 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:40.457209 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:40.473115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e152f60d-f8e5-40ee-a129-3aed03d4c19c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.408008 May 18 22:43:40.473733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 166/336] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:40 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:41.118086 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:41.119383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:41.126172 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:41.128935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:41.128935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:41.129834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:41.253278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:41.261707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dd3f732f-8a4e-41f3-a2f8-05b3efaf1a6e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1267 microversion: 2.1 time: 0.157625 May 18 22:43:41.270282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 171/337] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:41 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:41.490484 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:41.491274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:41.497843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:41.498550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:41.499789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:41.500314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:41.757270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:41.767808 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7aaddeab-a59c-4c7b-8b8a-98b768c87b6f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1522 microversion: 2.1 time: 0.281442 May 18 22:43:41.778940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 167/338] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:41 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:42.284992 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:42.286870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:42.296023 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:42.296737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:42.298037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:42.298778 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:42.388203 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:42.418404 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3919fb16-57f6-40d6-aa0f-31bb759d326f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1275 microversion: 2.1 time: 0.139819 May 18 22:43:42.420950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 172/339] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:42 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:42.788657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:42.789179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:42.804598 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:42.805962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:42.807299 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:42.808208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:43.199488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:43.210323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7c09c373-62b5-486b-97be-808957440f31 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1502 microversion: 2.1 time: 0.428848 May 18 22:43:43.217557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 168/340] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:42 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1502 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:43.230877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:43.231709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:43.245246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:43.252978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:43.254885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:43.255437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:43.437154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:43.437739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:43.445827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:43.446601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:43.447655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:43.448334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:43.607583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:43.617265 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f6b7f25e-1713-40df-9556-98451fd11056 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1273 microversion: 2.1 time: 0.184062 May 18 22:43:43.618318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 169/341] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:43 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:43.760376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:43.769217 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-599e3ffe-7c66-4779-b59c-08432f795978 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1516 microversion: 2.1 time: 0.543068 May 18 22:43:43.769785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 173/342] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:43 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1516 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:44.638779 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:44.640375 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:44.651963 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:44.653630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:44.655247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:44.655933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:44.989556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:45.003212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4f181b8e-6825-413b-9f71-19d54220d193 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1273 microversion: 2.1 time: 0.368729 May 18 22:43:45.008487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 170/343] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:44 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:46.031300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:46.031945 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:46.056708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:46.059959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:46.065420 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:46.067831 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:46.494544 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:46.507622 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bbfaca0e-27a3-4e78-b21b-396b4969f69b tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.485664 May 18 22:43:46.508454 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 174/344] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:46 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:47.209493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:47.211903 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:47.226428 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:47.227139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:47.228148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:47.228781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:47.235171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:47.274149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'flavor' on Instance uuid 5da5b596-3bb2-490e-b163-0649fbbc2657 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:43:47.526467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:47.528783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:47.537240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:47.543327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:47.546444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:47.548972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:47.550938 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:47.754153 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7c683a61-97b5-419e-8889-c902beda20d2 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/action" status: 200 len: 32 microversion: 2.1 time: 0.549389 May 18 22:43:47.760378 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 171/345] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:43:47 2022] POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/action => generated 32 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:43:47.768908 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:47.774442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:47.791296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:47.792990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:47.793977 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:47.794843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:48.134800 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:48.150500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-13643256-9aa8-4acb-a73b-9784fddd61d8 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.626596 May 18 22:43:48.151388 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:47 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:48.167595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-d10d7662-2718-4e2e-b6bf-b946c3f039a3 req-063869c4-a835-4ea8-830d-45dc9ea3bc8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ca2aee-83fb-432d-ab7b-3d0b3859b58f", "tag": "2117fff0-c6c8-48ef-98c5-88641010baf7"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:48.187313 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-d10d7662-2718-4e2e-b6bf-b946c3f039a3 req-063869c4-a835-4ea8-830d-45dc9ea3bc8b service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:48.192259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-d10d7662-2718-4e2e-b6bf-b946c3f039a3 req-063869c4-a835-4ea8-830d-45dc9ea3bc8b service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:48.219927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-d10d7662-2718-4e2e-b6bf-b946c3f039a3 req-063869c4-a835-4ea8-830d-45dc9ea3bc8b service nova] Creating event network-changed:2117fff0-c6c8-48ef-98c5-88641010baf7 for instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f on hv-cinder-83800 May 18 22:43:48.233384 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-d10d7662-2718-4e2e-b6bf-b946c3f039a3 req-063869c4-a835-4ea8-830d-45dc9ea3bc8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075132 May 18 22:43:48.241787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 176/347] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:43:48.343087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:48.356438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f2550a77-2ac7-4ff1-ab70-238906c8b734 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.593440 May 18 22:43:48.361729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 172/348] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:47 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:49.172181 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:49.175064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:49.183472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=10 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:49.187006 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:49.187768 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:49.188830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:49.189686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:49.382333 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:49.383282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:49.403682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:49.404150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:49.404945 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:49.405382 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:49.743230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:49.760346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6a5e86c8-3ed6-4fbc-a7b5-0df5e3c47dca tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.596442 May 18 22:43:49.761099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 177/349] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:49 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:49.827410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:49.845449 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b5cbbfa3-9c9c-4bd9-bf18-b232f3c8f9b9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.470805 May 18 22:43:49.846386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 173/350] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:49 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:50.400842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d7350e10-2c4b-439a-a264-5225b1dba4b9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'create', calling method: .version_select at 0x7f6cd9abed30>, body: {"keypair": {"name": "tempest-keypair-1930455554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWGE7RCeAPwKwOvbsLndx2cmrXZGOrbejYRbe8uLRKFs4YuGwihp6BKwn8xDao9wqrsikFfHRQvAKl8z6MEk2/MbeHjFTu61VGYOb6GT4pCfC0dljIgklBzcj7MyJxngg=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:50.425272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-d7350e10-2c4b-439a-a264-5225b1dba4b9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for project 3a7373826e4743088ff1d782782b9890. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:43:50.429900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-d7350e10-2c4b-439a-a264-5225b1dba4b9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for user 2ffacb9e00b8448eb56a233a5d564d0e and project 3a7373826e4743088ff1d782782b9890. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:43:50.613469 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d7350e10-2c4b-439a-a264-5225b1dba4b9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.523493 May 18 22:43:50.626290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 178/351] 10.222.0.70 () {62 vars in 1199 bytes} [Wed May 18 22:43:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 525 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 18 22:43:50.781586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:50.783092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:50.794134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:50.794743 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:50.795697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:50.796517 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:50.865995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:50.866965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:50.881397 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:50.881906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:50.886916 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:50.887669 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:51.097580 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:51.119119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-af30e8c2-da70-43b0-be50-b4f6bddd0d1f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.345672 May 18 22:43:51.122925 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 174/352] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:50 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:51.140425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:51.150986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a2137565-b0b8-4a1a-8741-af74148b5aa0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.290427 May 18 22:43:51.151848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 179/353] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:50 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:52.143034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:52.143034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:52.147131 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:52.147782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:52.148723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:52.149323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:52.168688 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:52.172844 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:52.177992 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:52.179512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:52.180965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:52.181841 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:52.473965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:52.488436 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a35f2c3-8f5e-4445-bd0d-a131e1de590f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.323467 May 18 22:43:52.489136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 180/354] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:52 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:52.501433 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:52.513196 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-40d8c1a1-2a46-46fd-a0b6-c75a0d7861c7 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.378055 May 18 22:43:52.522873 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 175/355] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:52 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:53.507400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:53.508015 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:53.515777 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:53.516214 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:53.517001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:53.517431 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:53.532517 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:53.533151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:53.541643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:53.542418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:53.544071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:53.544663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:53.782900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:53.798920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-04148de9-7270-4fdf-9a1b-cd8a24c0c095 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.296793 May 18 22:43:53.800084 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 181/356] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:53 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:53.808337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:53.816215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-782112385", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef8d9f04-cd89-47a5-92e7-968950a33380"}], "security_groups": [{"name": "tempest-securitygroup--1337514569"}], "key_name": "tempest-keypair-1930455554", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:53.816772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b6339a00-03fe-4470-a5e9-ac668c5a658e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.288021 May 18 22:43:53.826792 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 176/357] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:53 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:53.921721 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] validate_networks() for [('ef8d9f04-cd89-47a5-92e7-968950a33380', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:43:54.347411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:43:54.347841 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:43:54.348307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:43:54.348706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:43:54.349111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:43:54.365801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:54.366554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:54.372317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:54.372317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:54.395433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for project 3a7373826e4743088ff1d782782b9890. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:43:54.399804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for user 2ffacb9e00b8448eb56a233a5d564d0e and project 3a7373826e4743088ff1d782782b9890. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:43:54.411589 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:43:54.413899 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:43:54.543564 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de090a0f-af3a-410e-aa87-6f6899ca21fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.733316 May 18 22:43:54.544274 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 182/358] 10.222.0.70 () {62 vars in 1187 bytes} [Wed May 18 22:43:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 22:43:54.555695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1263ca72-349c-4f1f-a3e6-8befaa1d91fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:54.556298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1263ca72-349c-4f1f-a3e6-8befaa1d91fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:54.623951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1263ca72-349c-4f1f-a3e6-8befaa1d91fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:54.631568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1263ca72-349c-4f1f-a3e6-8befaa1d91fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:54.633113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1263ca72-349c-4f1f-a3e6-8befaa1d91fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:54.634241 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1263ca72-349c-4f1f-a3e6-8befaa1d91fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1281 microversion: 2.20 time: 0.082668 May 18 22:43:54.635260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 177/359] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:43:54 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:43:54.817710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:54.818411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:54.825736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:54.826769 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:54.828377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:54.829034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:54.849578 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:54.850222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:54.862707 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:54.863373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:54.864161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:54.864602 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:55.062140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:55.071352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e9b2c84a-190f-49e9-9d13-0411253f44f1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.258255 May 18 22:43:55.071985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 183/360] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:54 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:55.082906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:55.092342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-da368b46-e2f0-48eb-9083-a98718f34632 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.248544 May 18 22:43:55.092852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 178/361] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:54 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:55.652796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:55.653992 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:55.661575 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:55.662278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:55.663215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:55.663799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:55.736090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:55.746578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:55.748126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:55.749226 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eb1af5a8-e483-44b6-bf45-bb9f6c3ea497 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1285 microversion: 2.20 time: 0.100365 May 18 22:43:55.749788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 184/362] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:43:55 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:43:55.858752 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-750984b3-9b90-45fc-9be6-6c1b2df7cb7c req-c15aae18-1cfc-421f-8a2d-a0ed2ab1813b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca2aee-83fb-432d-ab7b-3d0b3859b58f", "name": "network-vif-plugged", "status": "completed", "tag": "2117fff0-c6c8-48ef-98c5-88641010baf7"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:43:55.873279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-750984b3-9b90-45fc-9be6-6c1b2df7cb7c req-c15aae18-1cfc-421f-8a2d-a0ed2ab1813b service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:55.874054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-750984b3-9b90-45fc-9be6-6c1b2df7cb7c req-c15aae18-1cfc-421f-8a2d-a0ed2ab1813b service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:55.892261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-750984b3-9b90-45fc-9be6-6c1b2df7cb7c req-c15aae18-1cfc-421f-8a2d-a0ed2ab1813b service nova] Creating event network-vif-plugged:2117fff0-c6c8-48ef-98c5-88641010baf7 for instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f on hv-cinder-83800 May 18 22:43:55.894279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-750984b3-9b90-45fc-9be6-6c1b2df7cb7c req-c15aae18-1cfc-421f-8a2d-a0ed2ab1813b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041816 May 18 22:43:55.895242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 179/363] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:43:56.088553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:56.089162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:56.091060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:56.095723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:56.096814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:56.097581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:56.098055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:56.108970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:56.109668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:56.116668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:56.117174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:56.118078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:56.118521 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:56.361930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:56.371737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:56.373921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a83f24b-bf6f-4f5b-90f1-4b5cd38881f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.289035 May 18 22:43:56.375169 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 185/364] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:56 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:56.389651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5bb88b21-15ad-487b-922e-ec31f38994a2 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.284707 May 18 22:43:56.395501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 180/365] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:56 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:56.768014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:56.769378 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:56.776410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:56.777044 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:56.777803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:56.778261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:56.849840 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:56.858592 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:56.860154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:56.861917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-88601cc8-816d-460e-bd8c-75b6fdf6b106 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1333 microversion: 2.20 time: 0.097615 May 18 22:43:56.862508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 186/366] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:43:56 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:43:57.396196 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:57.396943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:57.405542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:57.406298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:57.407245 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:57.408105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:57.415000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:57.419467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:57.431221 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:57.431721 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:57.432713 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:57.433365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:57.617348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:57.626488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0fa3ebd1-d312-45cb-aed0-9a61d4cfeb0f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.234860 May 18 22:43:57.627358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 181/367] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:57 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:57.647986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:57.655472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d5785e42-f690-4a41-bd0a-f24b62af8f1c tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.245759 May 18 22:43:57.656042 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 187/368] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:57 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:57.880769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:57.881381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:57.887664 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:57.888114 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:57.888887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:57.889327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:57.951641 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:57.970049 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:57.972127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:57.973257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-74954be6-5d0d-493d-9523-7da81c6992d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1333 microversion: 2.20 time: 0.097849 May 18 22:43:57.973822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 182/369] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:43:57 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:43:58.643866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:58.644485 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:58.650518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:58.650969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:58.651737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:58.652184 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:58.672586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:58.673191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:58.681370 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:58.682307 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:58.683250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:58.683686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:58.855835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:58.864007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a2374ac1-90d7-4d1b-8bd9-7c038c0dcfae tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.224679 May 18 22:43:58.864969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 188/370] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:58 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:43:58.868550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:58.876199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7e51627a-d117-4cff-bdc4-7950b5c1addb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1315 microversion: 2.1 time: 0.207428 May 18 22:43:58.876756 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 183/371] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:58 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:43:58.992234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:58.993002 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:58.999189 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:58.999622 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:59.000387 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:59.000813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:59.018909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:43:59.090616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:59.109515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:59.111527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:43:59.112715 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-516d7ea1-4f58-49df-85ca-e60280f08b41 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1351 microversion: 2.20 time: 0.124724 May 18 22:43:59.113635 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 189/372] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:43:58 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:43:59.880720 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:59.881375 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:59.887913 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:59.888371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:59.889341 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:59.890080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:59.893170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:43:59.893698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:43:59.901299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:59.901752 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:43:59.903846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:43:59.903846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.168838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:00.176557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dbc3fbc3-dfd7-491b-b891-8d2f8def2cb8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.299660 May 18 22:44:00.179608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 184/373] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:59 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:00.182441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:00.183790 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:00.184396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:00.191262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:00.192062 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.192981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:00.193254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3168bca4-a552-483c-9af3-fff3715b3b4d tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1465 microversion: 2.1 time: 0.304473 May 18 22:44:00.193754 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.194395 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 190/374] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:43:59 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1465 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:00.241857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:00.242561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:00.249028 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:00.249481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.250307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:00.250743 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.281362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:44:00.582707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8530c896-3a41-497e-8282-153c439d08fe tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 204 len: 0 microversion: 2.1 time: 0.344279 May 18 22:44:00.583311 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 191/375] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:44:00 2022] DELETE /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 22:44:00.592208 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:00.592977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:00.599909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:00.600356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.601120 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:00.601546 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:00.728503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:00.737359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:00.739291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:00.740643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-569e123c-4f7e-47f3-8af5-8704b4f06fd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.562275 May 18 22:44:00.751339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 185/376] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:00 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:00.840919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:00.849654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e03536d3-7839-4648-81af-669447daf86e tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1471 microversion: 2.1 time: 0.261663 May 18 22:44:00.850304 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 192/377] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:00 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:01.193560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:01.194187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:01.196574 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=58 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:01.201294 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.201732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.202520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.202945 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.450301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:01.458998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fd6a9fc8-7259-407a-9db3-3a3dab2be7c6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.269091 May 18 22:44:01.464083 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 186/378] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:01 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:01.691014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a0df2ff6-f2bd-4040-b7d2-ccad7b188d61 req-adeeb541-f2b9-4b1a-91d7-6719fe3a2af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:01.700063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a0df2ff6-f2bd-4040-b7d2-ccad7b188d61 req-adeeb541-f2b9-4b1a-91d7-6719fe3a2af1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.700562 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a0df2ff6-f2bd-4040-b7d2-ccad7b188d61 req-adeeb541-f2b9-4b1a-91d7-6719fe3a2af1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.715528 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a0df2ff6-f2bd-4040-b7d2-ccad7b188d61 req-adeeb541-f2b9-4b1a-91d7-6719fe3a2af1 service nova] Creating event network-changed:96fba53d-5676-4c31-9cb9-19ddb31ada27 for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 on hv-cinder-83800 May 18 22:44:01.721050 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-a0df2ff6-f2bd-4040-b7d2-ccad7b188d61 req-adeeb541-f2b9-4b1a-91d7-6719fe3a2af1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034258 May 18 22:44:01.722162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 193/379] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:01.759373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:01.759985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:01.766199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.766640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.768493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.769092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.788815 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:01.869068 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:01.869795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:01.876204 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.876653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.877596 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:01.878057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:01.913698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:01.923139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:01.927467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:01.929132 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9d751757-a046-4a52-b1af-0518be6742dc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.173755 May 18 22:44:01.929702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 187/380] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:01 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:02.047267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:02.056892 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a5e89bb6-9b88-4d3a-9c67-660a2d057b63 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1471 microversion: 2.1 time: 0.191946 May 18 22:44:02.058033 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 194/381] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:01 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:02.478418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:02.485610 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:02.494432 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:02.494888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:02.495666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:02.496105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:02.631053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:02.638624 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-966827c6-ef28-4aea-8cea-29dc7f92060a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.165281 May 18 22:44:02.641297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 188/382] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:02 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:02.946768 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:02.947393 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:02.954099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:02.954542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:02.955911 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:02.956336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:03.075399 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:03.076439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:03.083979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:03.086369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:03.086369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:03.086369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:03.101917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:03.109959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:03.112972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:03.113416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fe9dc584-e2d6-48fd-b229-583f1d29b73e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.170590 May 18 22:44:03.114075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 195/383] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:02 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:03.231791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:03.239915 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b1fe213d-a10b-424f-9d28-d5112bd406bb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1471 microversion: 2.1 time: 0.168724 May 18 22:44:03.240508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 189/384] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:03 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:03.655686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:03.656326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:03.668164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:03.668164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:03.668164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:03.668164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:03.883715 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:03.891438 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-89939393-1f58-4061-8994-ac1e258e2fa9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.239846 May 18 22:44:03.901219 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 196/385] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:03 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:04.132030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:04.133305 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:04.145752 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.146238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:04.147071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.147506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:04.257644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:04.258512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:04.269587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.270536 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:04.272316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.272985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:04.281788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:04.291025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:04.294347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:04.302896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7775e2bf-3707-4e03-9851-4a20a71db00b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.168760 May 18 22:44:04.302896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 190/386] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:04 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:04.383025 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.406934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=10 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:04.421927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:04.430525 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0a020b29-29e4-4439-a18d-cec443024fa5 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1471 microversion: 2.1 time: 0.176744 May 18 22:44:04.431311 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 197/387] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:04 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:04.514797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-96dc453c-3c62-4687-85c9-aa9faf548aa7 req-5a723120-6f59-47be-b8a1-ddc7534c5d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ca2aee-83fb-432d-ab7b-3d0b3859b58f", "name": "network-vif-deleted", "tag": "2117fff0-c6c8-48ef-98c5-88641010baf7"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:04.524728 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-96dc453c-3c62-4687-85c9-aa9faf548aa7 req-5a723120-6f59-47be-b8a1-ddc7534c5d09 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.525505 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-96dc453c-3c62-4687-85c9-aa9faf548aa7 req-5a723120-6f59-47be-b8a1-ddc7534c5d09 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:04.539657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-96dc453c-3c62-4687-85c9-aa9faf548aa7 req-5a723120-6f59-47be-b8a1-ddc7534c5d09 service nova] Creating event network-vif-deleted:2117fff0-c6c8-48ef-98c5-88641010baf7 for instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f on hv-cinder-83800 May 18 22:44:04.544829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-96dc453c-3c62-4687-85c9-aa9faf548aa7 req-5a723120-6f59-47be-b8a1-ddc7534c5d09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 May 18 22:44:04.545500 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 191/388] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:04.909641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:04.910286 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:04.917819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.918301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:04.919071 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:04.919510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:05.124284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:05.139550 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c2e1cda7-e24d-4b05-8a3c-fcb36c77ba17 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.234633 May 18 22:44:05.149803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 198/389] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:04 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:05.314102 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:05.322824 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:05.322824 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:05.329559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:05.330243 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:05.331442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:05.331952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:05.449293 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:05.451852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:05.463551 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:05.464356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:05.465547 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:05.466232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:05.510864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:05.511413 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:05.511761 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lazy-loading 'fault' on Instance uuid d1ca2aee-83fb-432d-ab7b-3d0b3859b58f {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:44:05.515153 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:05.524655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:05.527381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:05.527992 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e818ee74-492e-4ff6-adeb-df51ad68c38e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.214521 May 18 22:44:05.528801 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 192/390] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:05 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:05.563532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:05.571782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7c94c972-acb8-46da-9e41-7aea4bab252f tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1305 microversion: 2.1 time: 0.127544 May 18 22:44:05.572396 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 199/391] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:05 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:06.156952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:06.157552 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:06.164515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.168048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.168048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.168048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.297591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:06.307135 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-639e8121-70c9-4235-92d3-7e04e32cbacd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1502 microversion: 2.1 time: 0.154012 May 18 22:44:06.311732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 193/392] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:06 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:06.327171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f201df6-48af-4ac7-8820-cfcbc6e827f2"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:06.328369 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:06.341336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.341336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.341336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.341336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.364637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] HTTP exception thrown: Cannot 'attach_volume' instance 5da5b596-3bb2-490e-b163-0649fbbc2657 while it is in vm_state rescued May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Request method failure captured: May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/os-volume_attachments HTTP/1.1 May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 74 May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYbjbQ_ZECXKziv0DZA2jsqDVXSP0EvU9dofmfutAYSWvDZ81U29vslocOQviFQ316tWoKBt7Od5qL1GEX7Hynj86iWvdoINgd-2xRnIap59pJ9KS4mUSM4YamWixkWBcVmES0W5IxsL_ag2L4ho9fS-O55lcqVreepKfvdP0j2q0s May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:44:06.366342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c184ebb6e93a4cd58d65d8fbe43c4760", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c184ebb6e93a4cd58d65d8fbe43c4760"}]}] May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: be51e8b84bb7471bb17409b331e599eb May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {"volumeAttachment": {"volumeId": "7f201df6-48af-4ac7-8820-cfcbc6e827f2"}} May 18 22:44:06.367913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Cannot 'attach_volume' instance 5da5b596-3bb2-490e-b163-0649fbbc2657 while it is in vm_state rescued May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'server_id': '5da5b596-3bb2-490e-b163-0649fbbc2657', 'body': {'volumeAttachment': {'volumeId': '7f201df6-48af-4ac7-8820-cfcbc6e827f2'}}} May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:44:06.368846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5da5b596-3bb2-490e-b163-0649fbbc2657 while it is in vm_state rescued May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:44:06.370667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5da5b596-3bb2-490e-b163-0649fbbc2657 while it is in vm_state rescued May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Returning 409 to user: Cannot 'attach_volume' instance 5da5b596-3bb2-490e-b163-0649fbbc2657 while it is in vm_state rescued {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1458d3b7-9788-4362-b5b0-c2d33d4a0a74 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044553 May 18 22:44:06.371972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 200/393] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:44:06 2022] POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 18 22:44:06.377205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:06.377744 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:06.387557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.387557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.387557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.387557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.546325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:06.546867 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:06.554274 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.554717 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.555470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.556015 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.578063 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7fb27d39-6536-4d4a-ab97-e77fe5ee6337 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/action" status: 202 len: 0 microversion: 2.1 time: 0.204603 May 18 22:44:06.580935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 194/394] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:44:06 2022] POST /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:44:06.588796 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:06.589615 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:06.596117 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.596889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.597947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.598502 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.752353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:06.760838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:06.762554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:06.763817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-daee4511-693d-4248-af93-7d8abcc3feb4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.221557 May 18 22:44:06.764542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 201/395] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:06 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:44:06.769595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:06.770211 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:06.776530 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.777253 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.778186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.778621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.785941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:06.794251 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f4c390a6-3aa4-4952-ae1b-edefa844252b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.209272 May 18 22:44:06.795069 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 195/396] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:06 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:06.810312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:06.810762 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:06.811208 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lazy-loading 'fault' on Instance uuid d1ca2aee-83fb-432d-ab7b-3d0b3859b58f {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:44:06.853847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:06.861349 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ee6e6e1f-74b6-415b-90eb-866a86e34196 tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1305 microversion: 2.1 time: 0.095693 May 18 22:44:06.861920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 202/397] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:06 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:07.783035 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:07.783643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:07.791069 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:07.791556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:07.792316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:07.792751 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:07.811906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:07.812510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:07.818537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:07.819088 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:07.824255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:07.824255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:07.990273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:07.994346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:07.998601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:08.000097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:08.001281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-350bd35e-8d15-4963-8e38-487695254923 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.222151 May 18 22:44:08.001846 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 196/398] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:07 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:08.001961 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7cd4f0a8-1008-4e56-b50e-dc5f123e764f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.194074 May 18 22:44:08.002495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 203/399] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:07 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:08.008089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:08.008724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:08.014865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:08.015314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:08.017290 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:08.017290 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:08.046219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:08.046659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:08.047105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lazy-loading 'fault' on Instance uuid d1ca2aee-83fb-432d-ab7b-3d0b3859b58f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:44:08.095568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd1e0f88dc7f4eb494dea5d9af86a5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722f661c6312401b855c408a84d87639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:08.103108 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c69bc74f-e395-4715-b80a-e9a82d7cb3cb tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 200 len: 1305 microversion: 2.1 time: 0.100117 May 18 22:44:08.103665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 197/400] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:08 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:09.023368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:09.024038 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:09.024346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:09.025538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:09.035640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:09.038215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:09.038215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:09.038215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:09.038502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:09.038791 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:09.039591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:09.040028 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:09.369321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:09.372882 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:09.374082 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:09.377806 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:09.379590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:09.381155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-10b28c45-4591-41f1-acdc-c5060d2442da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.363573 May 18 22:44:09.381931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 204/401] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:09 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:09.386156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6f59b363-54c0-41c4-bc32-b688c14fbbe6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.365861 May 18 22:44:09.386156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 198/402] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:09 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:09.391902 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:09.392704 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] [instance: d1ca2aee-83fb-432d-ab7b-3d0b3859b58f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:09.399520 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:09.399972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:09.400738 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:09.401200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:09.416619 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] HTTP exception thrown: Instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f could not be found. May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Request method failure captured: May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f HTTP/1.1 May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXaVI3JOpzrat2mn3vfBc-GkfmiZeka2AKf2do3Pc8ciAhzjja_6usUguhMZJKgJnixMsTcc9Nu4as8Bbt17AbR4m6qTSTKkXPgVb5NcDfyL30Gc5-XKBtnoEiku6TgNDvrFEapmL-5LQd_nci-00H_hZkek9vy9Jkhp6HHZ8X9QAWc May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 722f661c6312401b855c408a84d87639 May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesNegativeTest-1295561750 May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:44:09.418234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_722f661c6312401b855c408a84d87639", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/722f661c6312401b855c408a84d87639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/722f661c6312401b855c408a84d87639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/722f661c6312401b855c408a84d87639"}]}] May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesNegativeTest-1295561750 May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 722f661c6312401b855c408a84d87639 May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesNegativeTest-1295561750 May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesNegativeTest-1295561750-project May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: bd1e0f88dc7f4eb494dea5d9af86a5f9 May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesNegativeTest-1295561750-project May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f could not be found. May 18 22:44:09.419699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'd1ca2aee-83fb-432d-ab7b-3d0b3859b58f'} May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f could not be found. May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:44:09.420457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f could not be found. May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f could not be found. May 18 22:44:09.421819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:44:09.423258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] Returning 404 to user: Instance d1ca2aee-83fb-432d-ab7b-3d0b3859b58f could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:44:09.423258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2819e9cc-2a89-485b-812b-3c1d9ce312cd tempest-VolumesNegativeTest-1295561750 tempest-VolumesNegativeTest-1295561750-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f" status: 404 len: 111 microversion: 2.1 time: 0.036668 May 18 22:44:09.423258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 205/403] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:09 2022] GET /compute/v2.1/servers/d1ca2aee-83fb-432d-ab7b-3d0b3859b58f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:44:10.399481 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:10.400179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:10.401231 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:10.401929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:10.406925 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:10.407451 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:10.408294 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:10.408808 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:10.411985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:10.412515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:10.414963 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:10.414963 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:10.613294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:10.620301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:10.621724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f1fd5143-a439-484c-93c9-be274f1cbecf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.224825 May 18 22:44:10.622320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 206/404] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:10 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:10.628396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:10.630490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:10.631517 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-69845c84-320d-4f35-b2a9-949c47b55c59 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.236584 May 18 22:44:10.632056 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 199/405] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:10 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:11.640030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:11.640642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:11.647952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:11.648417 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:11.649195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:11.649632 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:11.649892 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:11.650628 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:11.657146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:11.657662 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:11.658523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:11.659044 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:11.848934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:11.852892 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:11.858021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-36dbaef6-3fae-4e15-935d-8c91a8709c3d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.221812 May 18 22:44:11.858704 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 207/406] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:11 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:11.869705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:11.871243 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:11.872329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-08a295d0-af44-46c9-811b-4b660c67859c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.227442 May 18 22:44:11.872876 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 200/407] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:11 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:12.875747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:12.876229 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:12.884788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:12.885495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:12.886316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:12.886752 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:12.891923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:12.892616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:12.901269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:12.901997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:12.903192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:12.903851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:13.086680 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:13.094383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3bc0dd16-786a-4e5c-ba69-380bba8a1d1d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.223242 May 18 22:44:13.094962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 208/408] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:12 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:13.119080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:13.127037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:13.128586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:13.129736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8bfe0f31-fd7a-4615-874e-0a6244f9b8ab tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.242610 May 18 22:44:13.130392 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 201/409] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:12 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:14.112084 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:14.112618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:14.118881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:14.119323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:14.120133 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:14.120566 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:14.149206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:14.149941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:14.156567 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:14.157081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:14.158152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:14.158652 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:14.308061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:14.318580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-92c2cf74-f7ac-4bd4-a683-82168d1c8e47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.210586 May 18 22:44:14.327113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 209/410] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:14 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:14.345136 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:14.354330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:14.356033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:14.357122 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0fbc55eb-cba2-4366-9c3d-cfcb74ef3e6a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.212639 May 18 22:44:14.357678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 202/411] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:14 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:44:15.339534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:15.340672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:15.353267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:15.354296 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:15.357618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:15.358649 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:15.375001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:15.375873 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:15.389983 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:15.390683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:15.391697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:15.392311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:15.420268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:15.579848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:15.591021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8628f366-9550-454f-8488-15364bc63146 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.256477 May 18 22:44:15.592152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 210/412] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:15 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:15.609738 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:15.618022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:15.619533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:15.620637 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-82fc9385-54cb-4f80-a832-4bbaf99c57b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.249530 May 18 22:44:15.621199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 203/413] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:15 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:16.562956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-f75ec6ae-07fc-401d-8616-fa1133ac8b29 req-b5816283-d83f-43e8-8c75-767fc6070778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "name": "network-vif-plugged", "status": "completed", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:16.573308 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-f75ec6ae-07fc-401d-8616-fa1133ac8b29 req-b5816283-d83f-43e8-8c75-767fc6070778 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:16.573816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-f75ec6ae-07fc-401d-8616-fa1133ac8b29 req-b5816283-d83f-43e8-8c75-767fc6070778 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:16.585094 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-f75ec6ae-07fc-401d-8616-fa1133ac8b29 req-b5816283-d83f-43e8-8c75-767fc6070778 service nova] Creating event network-vif-plugged:96fba53d-5676-4c31-9cb9-19ddb31ada27 for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 on hv-cinder-83800 May 18 22:44:16.591293 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-f75ec6ae-07fc-401d-8616-fa1133ac8b29 req-b5816283-d83f-43e8-8c75-767fc6070778 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 May 18 22:44:16.591885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 211/414] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:16.608985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:16.609627 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:16.616492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:16.617299 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:16.618165 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:16.618611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:16.642890 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:16.643754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:16.652997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:16.653583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:16.654479 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:16.655139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:16.849069 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:16.858073 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:16.867431 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:16.868616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-be5f2a21-9036-42d9-a9ab-b401a462563e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1510 microversion: 2.1 time: 0.263772 May 18 22:44:16.870386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 204/415] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:16 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:16.870498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:16.870989 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1f49b153-1854-4e10-a5c9-60726cc2b9e0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.234325 May 18 22:44:16.874034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 212/416] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:16 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:17.888371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:17.890681 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:17.893960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:17.899641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:17.900660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:17.901267 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:17.902550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:17.903130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:17.903881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:17.904626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:17.906314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:17.906928 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:18.136957 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:18.141034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:18.145159 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:18.146670 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:18.147782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4ab5ae02-e12f-4601-9dfb-bd6a404a080f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1407 microversion: 2.20 time: 0.262598 May 18 22:44:18.149162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-57adfd34-26e1-4061-946c-0d0c2e5ba998 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1516 microversion: 2.1 time: 0.264583 May 18 22:44:18.149293 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 213/417] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:17 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:18.150022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 205/418] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:17 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:19.167137 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:19.167734 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:19.174026 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:19.174498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:19.175283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:19.175711 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:19.325455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:19.333690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:19.335199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:19.336925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f5c12f17-30b3-4f4b-b4fc-ca06ca9f1c5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1600 microversion: 2.20 time: 0.174421 May 18 22:44:19.337486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 214/419] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:44:19 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:44:19.354562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:19.355076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:19.361431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:19.362073 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:19.362999 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:19.363432 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:19.448405 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-900127c8-17b0-4974-bb66-cb68dcbe1cb7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097919 May 18 22:44:19.449022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 206/420] 10.222.0.70 () {60 vars in 1315 bytes} [Wed May 18 22:44:19 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:44:20.840736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-6bb07360-32e0-4698-a42b-4739e8dc80f2 req-9d7d67b8-ef3a-4a65-9e5e-c3134ac6892f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:20.849567 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6bb07360-32e0-4698-a42b-4739e8dc80f2 req-9d7d67b8-ef3a-4a65-9e5e-c3134ac6892f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:20.850108 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6bb07360-32e0-4698-a42b-4739e8dc80f2 req-9d7d67b8-ef3a-4a65-9e5e-c3134ac6892f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:20.866293 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-6bb07360-32e0-4698-a42b-4739e8dc80f2 req-9d7d67b8-ef3a-4a65-9e5e-c3134ac6892f service nova] Creating event network-changed:96fba53d-5676-4c31-9cb9-19ddb31ada27 for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 on hv-cinder-83800 May 18 22:44:20.875236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-6bb07360-32e0-4698-a42b-4739e8dc80f2 req-9d7d67b8-ef3a-4a65-9e5e-c3134ac6892f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038500 May 18 22:44:20.877458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 215/421] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:20.918973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-99c34bb0-6664-47cf-b7e9-c3aac872bd91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'create', calling method: .version_select at 0x7f6cd90f39d0>, body: {"keypair": {"name": "tempest-keypair-1124707447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO0YDTB3FjcmxmPcKE+dp9epP3WNodTcdQQE8szq/N7XPS8AH+xL5D/hTEvBbIoI8v0vYFrw/R8146eTH3u8wUlWVJAX9B61s3x7R0NZTrmoM6jyba5OOA8lS7CPJNgqQ=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:20.948274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-99c34bb0-6664-47cf-b7e9-c3aac872bd91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:44:20.952699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-99c34bb0-6664-47cf-b7e9-c3aac872bd91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for user be51e8b84bb7471bb17409b331e599eb and project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:44:21.047331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-99c34bb0-6664-47cf-b7e9-c3aac872bd91 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133454 May 18 22:44:21.047851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 207/422] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:44:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:23.933758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1705806000", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11499028-97ea-4e44-af1f-548128f3e70d"}], "security_groups": [{"name": "tempest-securitygroup--1064981010"}], "key_name": "tempest-keypair-1124707447", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:24.050781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] validate_networks() for [('11499028-97ea-4e44-af1f-548128f3e70d', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:44:24.454895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:44:24.455404 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:44:24.455878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:44:24.456279 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:44:24.457186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:44:24.468028 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:24.468704 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:24.469494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:24.469925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:24.487146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:44:24.491790 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Getting quotas for user be51e8b84bb7471bb17409b331e599eb and project c184ebb6e93a4cd58d65d8fbe43c4760. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:44:24.507287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:44:24.513006 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:44:24.730806 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-009c7a18-12ce-42c1-977c-db77aadd1213 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.803311 May 18 22:44:24.731717 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 216/423] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:44:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:44:24.743377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-bc6461ec-9b04-45d4-b4f6-71bfe3dc2208 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:24.743986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-bc6461ec-9b04-45d4-b4f6-71bfe3dc2208 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:24.810219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bc6461ec-9b04-45d4-b4f6-71bfe3dc2208 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:24.818548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-bc6461ec-9b04-45d4-b4f6-71bfe3dc2208 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1246 microversion: 2.1 time: 0.080675 May 18 22:44:24.819127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 208/424] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:24 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:25.835576 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:25.836147 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:25.843561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:25.844011 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:25.845876 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:25.845876 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:25.911570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:25.919948 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-34b73f84-2968-40f9-b2c7-94e00d4ade2e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1250 microversion: 2.1 time: 0.088147 May 18 22:44:25.926647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 217/425] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:25 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:26.939770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:26.940950 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:26.957519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:26.958098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:26.958952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:26.959457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:27.076036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:27.084549 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f8b25441-ad1c-438e-a36b-c837f1057c60 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1306 microversion: 2.1 time: 0.150146 May 18 22:44:27.085165 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 209/426] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:26 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:28.102836 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:28.103462 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:28.105488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:28.110757 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:28.111322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:28.112099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:28.112532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:28.245245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:28.253663 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4fc276d2-a543-464a-973c-449c5f9cdafb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.154549 May 18 22:44:28.254253 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 218/427] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:28 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:29.271136 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:29.271726 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:29.279369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:29.279816 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:29.280581 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:29.281025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:29.408080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:29.415487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c69fa97c-fdbe-4cd6-b96f-e638f69e4c4a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.148223 May 18 22:44:29.416051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 210/428] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:29 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:30.433538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:30.434181 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:30.440639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:30.442801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:30.442801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:30.442801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:30.572743 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:30.580435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5f94f869-0c0d-4cdf-95d6-0f4e7a44990a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.151299 May 18 22:44:30.581041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 219/429] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:30 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:31.605286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:31.605286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:31.606369 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:31.606832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:31.607623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:31.608075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:31.752935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:31.760738 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e18a39df-d622-4b19-b2b6-40e084c223ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.167118 May 18 22:44:31.761980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 211/430] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:31 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:31.964375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-30f17960-42f4-40fb-8537-ee8a29193272 req-d215cb86-3916-4146-a96b-d89901e7d2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c0219f-b3e3-4a3c-98fa-247fb1d60b69", "tag": "be154673-4ae6-488f-9ecd-8923c95db8c4"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:31.984847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-30f17960-42f4-40fb-8537-ee8a29193272 req-d215cb86-3916-4146-a96b-d89901e7d2e7 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:31.985340 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-30f17960-42f4-40fb-8537-ee8a29193272 req-d215cb86-3916-4146-a96b-d89901e7d2e7 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:31.998413 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-30f17960-42f4-40fb-8537-ee8a29193272 req-d215cb86-3916-4146-a96b-d89901e7d2e7 service nova] Creating event network-changed:be154673-4ae6-488f-9ecd-8923c95db8c4 for instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 on hv-cinder-83800 May 18 22:44:32.003445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-30f17960-42f4-40fb-8537-ee8a29193272 req-d215cb86-3916-4146-a96b-d89901e7d2e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044761 May 18 22:44:32.004269 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 220/431] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:32.779078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:32.782536 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:32.783282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:32.786654 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:32.787113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:32.787889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:32.788327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:33.014306 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:33.022069 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ce93630d-db1e-4a79-b47a-bb7c2aa2a55f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.247550 May 18 22:44:33.022643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 212/432] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:32 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:34.040079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:34.040871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:34.047696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:34.048148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:34.048914 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:34.049352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:34.261209 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:34.268745 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-30121788-1ef8-4776-abd6-4fadf2c007fe tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.232960 May 18 22:44:34.269309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 221/433] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:34 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:35.285294 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:35.286131 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:35.288679 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:35.294459 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:35.294903 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:35.295669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:35.296099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:35.434335 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:35.442022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-185ba459-c182-48ca-86b6-d11fc15423d5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.160407 May 18 22:44:35.442589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 213/434] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:35 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:36.458735 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:36.459414 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:36.461363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:36.465312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:36.468657 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:36.469187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:36.470143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:36.470797 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:36.607392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:36.614761 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aeaf438e-27e2-418e-83cd-536442911839 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.159767 May 18 22:44:36.615349 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 222/435] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:36 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:37.631519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:37.631965 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:37.642181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:37.642629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:37.643389 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:37.643819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:37.779417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:37.787200 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c8c2f8b9-1cc7-4872-886f-dd37c6c87b47 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.159627 May 18 22:44:37.787774 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 214/436] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:37 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:38.822285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:38.822285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:38.822285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:38.822285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:38.823139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:38.823139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:38.951220 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:38.958652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0ffc4265-7f72-4771-bdf2-a6a843851ad4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.157986 May 18 22:44:38.959380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 223/437] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:38 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:44:39.975955 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:39.976630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:39.983889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:39.984344 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:39.985116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:39.985556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:40.127361 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:40.136157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0bf889ca-7014-4d21-a530-498edcfee3d8 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.163440 May 18 22:44:40.136997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 215/438] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:39 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:41.153813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:41.154443 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:41.160670 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:41.161112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:41.161866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:41.162325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:41.166204 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=95 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:41.569747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:41.577770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b1ba46b2-c771-485e-b5bc-5acf54090772 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.428049 May 18 22:44:41.578391 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 224/439] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:41 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:42.593736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:42.594367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:42.600838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:42.601287 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:42.602065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:42.602504 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:42.772075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:42.781686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b1b26709-00e8-487c-982d-1fd425b40b70 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.191604 May 18 22:44:42.792996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 216/440] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:42 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:43.799896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:43.800496 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:43.807010 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:43.808078 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:43.808959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:43.809516 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:43.944331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:43.949255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b27c3c26-5a24-4bb4-82d4-ab5dc1ada94b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.153089 May 18 22:44:43.949822 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 225/441] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:43 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:44.966071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:44.966749 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:44.973169 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:44.973624 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:44.974498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:44.974935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:45.107381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:45.114713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3ee6dcea-4684-4fea-954f-eb2c9021b54e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.152953 May 18 22:44:45.115281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 217/442] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:44 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:46.132216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:46.132841 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:46.139456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:46.139903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:46.140655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:46.141085 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:46.268571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:46.275910 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ea264568-4754-4807-977c-0735399555d3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.147506 May 18 22:44:46.276625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 226/443] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:46 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:47.292652 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:47.293289 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:47.299789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:47.300240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:47.301002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:47.301437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:47.305536 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=73 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:44:47.436878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:47.444219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7aafae29-7f1b-4d83-a48b-20f91a553a3b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.155523 May 18 22:44:47.444781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 218/444] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:47 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:48.461928 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:48.462622 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:48.469388 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:48.469831 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:48.470622 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:48.471052 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:48.638519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:48.646048 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e79780be-eb5f-4b02-972b-b16dc067fdb6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.188259 May 18 22:44:48.646631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 227/445] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:48 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:49.664887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:49.665601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:49.675134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:49.675582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:49.676363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:49.676799 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:49.815024 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:49.823499 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b4d749c2-5b7f-4125-9028-b3cb066dc365 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.163077 May 18 22:44:49.824198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 219/446] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:49 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:49.827910 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-07503f84-409a-40ba-8426-51d7e4ff4c56 req-295a9694-50a9-49f8-82ac-ccdfc70c79d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c0219f-b3e3-4a3c-98fa-247fb1d60b69", "name": "network-vif-plugged", "status": "completed", "tag": "be154673-4ae6-488f-9ecd-8923c95db8c4"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:49.838130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-07503f84-409a-40ba-8426-51d7e4ff4c56 req-295a9694-50a9-49f8-82ac-ccdfc70c79d6 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:49.842146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-07503f84-409a-40ba-8426-51d7e4ff4c56 req-295a9694-50a9-49f8-82ac-ccdfc70c79d6 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:49.855680 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-07503f84-409a-40ba-8426-51d7e4ff4c56 req-295a9694-50a9-49f8-82ac-ccdfc70c79d6 service nova] Creating event network-vif-plugged:be154673-4ae6-488f-9ecd-8923c95db8c4 for instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 on hv-cinder-83800 May 18 22:44:49.861621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-07503f84-409a-40ba-8426-51d7e4ff4c56 req-295a9694-50a9-49f8-82ac-ccdfc70c79d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037555 May 18 22:44:49.862612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 228/447] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:50.840970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:50.841493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:50.847957 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:50.848397 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:50.849149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:50.849582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:50.979101 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:50.987454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-14e8bc2d-8568-48f6-80af-1132829b1f55 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.150978 May 18 22:44:50.988038 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 220/448] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:50 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:52.004980 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:52.005678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:52.012022 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:52.012467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:52.013225 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:52.013660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:52.152959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:52.160479 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-533fab8c-b4b1-4b0b-a3fc-adcdd4817892 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.159598 May 18 22:44:52.161044 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 229/449] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:51 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:53.177954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:53.178616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:53.186457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:53.187237 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:53.188574 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:53.189341 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:53.321193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:53.328632 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d3ec3c35-7e8d-4570-b290-be59d5a41434 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1372 microversion: 2.1 time: 0.154821 May 18 22:44:53.329184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 221/450] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:53 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:54.345303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:54.345747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:54.351819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:54.352261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:54.353017 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:54.353450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:54.502619 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:44:54.510166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dd8d2347-5858-4f7d-aaf0-8fdae71e51f3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1566 microversion: 2.1 time: 0.169444 May 18 22:44:54.510755 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 230/451] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:44:54 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:44:54.527311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:44:54.528391 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:44:54.534943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:54.535385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:54.536157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:54.536579 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:54.618530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1eda105d-f6a4-4ee2-8b83-b54c6b4742a5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095096 May 18 22:44:54.625259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 222/452] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:44:54 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:44:55.666780 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-9bdec07a-29a8-46ca-9916-d952f1ec1fa3 req-e92ee44a-9318-4c61-8658-a39d37394b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c0219f-b3e3-4a3c-98fa-247fb1d60b69", "tag": "be154673-4ae6-488f-9ecd-8923c95db8c4"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:44:55.675534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-9bdec07a-29a8-46ca-9916-d952f1ec1fa3 req-e92ee44a-9318-4c61-8658-a39d37394b06 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:44:55.676094 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-9bdec07a-29a8-46ca-9916-d952f1ec1fa3 req-e92ee44a-9318-4c61-8658-a39d37394b06 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:44:55.689798 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-9bdec07a-29a8-46ca-9916-d952f1ec1fa3 req-e92ee44a-9318-4c61-8658-a39d37394b06 service nova] Creating event network-changed:be154673-4ae6-488f-9ecd-8923c95db8c4 for instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 on hv-cinder-83800 May 18 22:44:55.695678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-9bdec07a-29a8-46ca-9916-d952f1ec1fa3 req-e92ee44a-9318-4c61-8658-a39d37394b06 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 May 18 22:44:55.696463 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 231/453] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:04.366463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:04.367044 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:04.374670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:04.375365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:04.376371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:04.377129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:04.429297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-aecde59d-5a0b-48c0-bc98-0927001d684d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/ips" status: 200 len: 149 microversion: 2.1 time: 0.068349 May 18 22:45:04.429885 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 223/454] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:45:04 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:07.826892 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=27 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:07.827645 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=39 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:08.005713 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c5071221-392c-415a-9709-fdc812453432 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Action: 'create', calling method: .version_select at 0x7f6cd98f0ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-923270520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5aVV+M1Y2Z+ehHQrrioTqcMSNrSAeI+6OfPaBOaoIZXgTcn+DlQwSEdSftVPH6eG3bBFCyYuplVMz/saUvUyYKEiaS5XxowgLTQhWzeXrQz+wq90zXIcxhlR+bjMVRJA=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:08.021307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-c5071221-392c-415a-9709-fdc812453432 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:45:08.025234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-c5071221-392c-415a-9709-fdc812453432 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for user 298370ea294c4150be7de29116e49d73 and project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:45:08.117923 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c5071221-392c-415a-9709-fdc812453432 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.292416 May 18 22:45:08.118591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 232/455] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:45:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:08.477051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:08.479052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:08.483010 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=24 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:08.486998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:08.487827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:08.488800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:08.489454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:09.401130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-98fb4d17-1c6e-44f7-803c-b57bd84cea34 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927797 May 18 22:45:09.401840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 224/456] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:45:08 2022] POST /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:19.085939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-daf902c1-beeb-4769-ac22-970b65944f6b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: .version_select at 0x7f6cd9069280>, body: {"keypair": {"name": "tempest-keypair-310297856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE71xRjpQCSLqZPZ0RRGbSHUxTlT2iT6/3vYlpWaR+Zz8EiIm8z09tIn2R7KmBYIARLSdVeZIFiCoxcZAytNoKs0Vc0KkLgOUUIbEd6NMubqgW7OTmtvxsXbVKPOagtzuw=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:19.090038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:19.090696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:19.101220 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-daf902c1-beeb-4769-ac22-970b65944f6b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:45:19.105152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-daf902c1-beeb-4769-ac22-970b65944f6b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:45:19.197655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-daf902c1-beeb-4769-ac22-970b65944f6b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116031 May 18 22:45:19.198277 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 233/457] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:45:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:21.571586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:21.572250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:21.578658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1182118212", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbd3cb94-6b06-443d-a376-6f705f586753"}], "security_groups": [{"name": "tempest-securitygroup--2134114542"}], "key_name": "tempest-keypair-310297856", "user_data": "}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:27.993405 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] validate_networks() for [('fbd3cb94-6b06-443d-a376-6f705f586753', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:45:28.762320 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:45:28.762739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:45:28.763203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:45:28.763608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:45:28.764002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:45:28.774126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:28.774612 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:28.775444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:28.775873 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:28.798420 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:45:28.802701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:45:28.814409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:45:28.817136 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:45:28.933086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-63dfbe67-46a6-491b-b170-64b3fa1b6b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 7.363219 May 18 22:45:28.933731 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 225/458] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:45:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 7365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:45:28.944358 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a8ff381d-2e2f-458a-ba05-1cc5356fcbc9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:28.947028 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a8ff381d-2e2f-458a-ba05-1cc5356fcbc9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:29.003864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a8ff381d-2e2f-458a-ba05-1cc5356fcbc9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:29.011491 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a8ff381d-2e2f-458a-ba05-1cc5356fcbc9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1241 microversion: 2.1 time: 0.071076 May 18 22:45:29.012252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 234/459] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:28 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:30.031181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:30.032099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:30.043140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:30.043754 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:30.044563 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:30.045000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:30.110202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:30.119245 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5e088c4c-c088-4752-a766-60b712c85f51 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1245 microversion: 2.1 time: 0.093572 May 18 22:45:30.119798 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 226/460] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:30 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:45:31.140787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:31.141412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:31.148014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:31.148469 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:31.149249 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:31.149687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:31.210793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:31.218484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9a2f65d0-3db2-436d-8573-d300ac307d96 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1293 microversion: 2.1 time: 0.082413 May 18 22:45:31.219065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 235/461] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:31 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:32.237030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:32.238955 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:32.245901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:32.246677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:32.247679 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:32.248352 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:32.322816 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:32.330247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-abc17786-10d7-4db6-9443-8ce816fb1adf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1299 microversion: 2.1 time: 0.097006 May 18 22:45:32.330807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 227/462] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:32 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:33.348021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:33.349379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:33.356536 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:33.357072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:33.358068 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:33.358702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:33.539078 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:33.546447 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a8fb1aa8-c538-4054-8969-36ec7e4d1bf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.202559 May 18 22:45:33.547015 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 236/463] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:33 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:33.691937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-d36e8fc1-7f06-4772-8e62-adfbdc14f17f req-6cff4c77-d620-4f19-9ac1-2e38b8a1b51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11859bc6-9f40-4ebd-a362-f02edc56387f", "tag": "7dae3f3b-8bc8-4a34-8417-b95ba6b1c353"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:33.702152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-d36e8fc1-7f06-4772-8e62-adfbdc14f17f req-6cff4c77-d620-4f19-9ac1-2e38b8a1b51e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:33.702713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-d36e8fc1-7f06-4772-8e62-adfbdc14f17f req-6cff4c77-d620-4f19-9ac1-2e38b8a1b51e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:33.721629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-d36e8fc1-7f06-4772-8e62-adfbdc14f17f req-6cff4c77-d620-4f19-9ac1-2e38b8a1b51e service nova] Creating event network-changed:7dae3f3b-8bc8-4a34-8417-b95ba6b1c353 for instance 11859bc6-9f40-4ebd-a362-f02edc56387f on hv-cinder-83800 May 18 22:45:33.727068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-d36e8fc1-7f06-4772-8e62-adfbdc14f17f req-6cff4c77-d620-4f19-9ac1-2e38b8a1b51e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043192 May 18 22:45:33.728059 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 228/464] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:34.564336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:34.565004 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:34.571999 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:34.572377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:34.573142 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:34.573578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:34.771398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:34.778777 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b695967f-84ba-4d9e-ba53-1f57ae441f82 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.218333 May 18 22:45:34.779337 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 237/465] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:34 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:35.797619 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:35.798271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:35.805962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:35.806434 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:35.807201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:35.807645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:35.940325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:35.948442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e4e6ccbf-433e-49a2-b0a6-ed8bcc76c013 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.155328 May 18 22:45:35.950534 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 229/466] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:35 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:36.965396 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:36.965997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:36.972343 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:36.972814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:36.973585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:36.974082 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:37.113593 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:37.122026 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c21b6644-eba0-4786-ba2d-321af4d22e37 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.160423 May 18 22:45:37.122598 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 238/467] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:36 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:38.139797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:38.140403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:38.147392 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:38.158358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:38.158358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:38.158358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:38.286560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:38.294683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a71ed067-1dfb-4ed7-8941-c7d45d42c3af tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.158942 May 18 22:45:38.295248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 230/468] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:38 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:39.312626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:39.313244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:39.315101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:39.320617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:39.321073 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:39.321847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:39.322323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:39.449287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:39.457080 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6cab5acf-a4dc-4014-a57f-44345656502a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.148329 May 18 22:45:39.461366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 239/469] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:39 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:40.474318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:40.474924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:40.477385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:40.478123 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:40.483300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:40.483747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:40.484503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:40.484934 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:40.615671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:40.623145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-19f72751-362f-4388-89ed-86de5643a3cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.152708 May 18 22:45:40.623653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 231/470] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:40 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:41.640324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:41.640930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:41.647011 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:41.647462 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:41.648316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:41.648659 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:41.779415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:41.786994 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-858a2ce7-818a-4a80-ae31-34c40f7dd79a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.150496 May 18 22:45:41.787423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 240/471] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:41 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:42.806826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:42.808115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:42.809317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-bf4495cc-d37a-49fc-b002-8136329b36bb req-48fbbe73-12d7-42cc-9bb8-422745de6fbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11859bc6-9f40-4ebd-a362-f02edc56387f", "name": "network-vif-plugged", "status": "completed", "tag": "7dae3f3b-8bc8-4a34-8417-b95ba6b1c353"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:42.817465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:42.817918 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:42.818353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-bf4495cc-d37a-49fc-b002-8136329b36bb req-48fbbe73-12d7-42cc-9bb8-422745de6fbe service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:42.818707 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:42.818811 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-bf4495cc-d37a-49fc-b002-8136329b36bb req-48fbbe73-12d7-42cc-9bb8-422745de6fbe service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:42.819140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:42.831786 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-bf4495cc-d37a-49fc-b002-8136329b36bb req-48fbbe73-12d7-42cc-9bb8-422745de6fbe service nova] Creating event network-vif-plugged:7dae3f3b-8bc8-4a34-8417-b95ba6b1c353 for instance 11859bc6-9f40-4ebd-a362-f02edc56387f on hv-cinder-83800 May 18 22:45:42.836643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-bf4495cc-d37a-49fc-b002-8136329b36bb req-48fbbe73-12d7-42cc-9bb8-422745de6fbe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031179 May 18 22:45:42.837330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 241/472] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:42.963829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:42.972776 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9b85ae41-794b-4c4b-9db7-2f48d4adfd18 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.171618 May 18 22:45:42.973352 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 232/473] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:42 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:43.992507 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:43.993216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:43.999288 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:43.999754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:44.000502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:44.000927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:44.131114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:44.139077 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ce9f6353-e907-4fa0-85bb-3230e41e6c6a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.151065 May 18 22:45:44.139632 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 242/474] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:43 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:45.156161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:45.156800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:45.163348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:45.163817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:45.164576 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:45.165009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:45.295406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:45.303030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e6fc3d1f-6920-42f7-9feb-5340475052a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1367 microversion: 2.1 time: 0.150697 May 18 22:45:45.303594 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 233/475] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:45 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:46.321548 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:46.322202 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:46.328482 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:46.328930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:46.329686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:46.330151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:46.460891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:46.468320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-43c923c9-8156-4233-9e44-9da4d0876b4e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1556 microversion: 2.1 time: 0.151550 May 18 22:45:46.468873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 243/476] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:46 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:46.484994 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:46.485494 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:46.492337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:46.494197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:46.494197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:46.494543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:46.576444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a9fee9f0-229f-4431-ad83-149901ecc09c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095266 May 18 22:45:46.577049 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 234/477] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:45:46 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:47.792008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-b0a5e7b3-9695-442a-b4fd-10e130537a6d req-228387eb-9840-46aa-9352-2b7976b022d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11859bc6-9f40-4ebd-a362-f02edc56387f", "tag": "7dae3f3b-8bc8-4a34-8417-b95ba6b1c353"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:47.800064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b0a5e7b3-9695-442a-b4fd-10e130537a6d req-228387eb-9840-46aa-9352-2b7976b022d2 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:47.800581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b0a5e7b3-9695-442a-b4fd-10e130537a6d req-228387eb-9840-46aa-9352-2b7976b022d2 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:47.812400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-b0a5e7b3-9695-442a-b4fd-10e130537a6d req-228387eb-9840-46aa-9352-2b7976b022d2 service nova] Creating event network-changed:7dae3f3b-8bc8-4a34-8417-b95ba6b1c353 for instance 11859bc6-9f40-4ebd-a362-f02edc56387f on hv-cinder-83800 May 18 22:45:47.817355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-b0a5e7b3-9695-442a-b4fd-10e130537a6d req-228387eb-9840-46aa-9352-2b7976b022d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029615 May 18 22:45:47.817941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 244/478] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:50.899740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1964853459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923270520", "security_groups": [{"name": "tempest-secgroup-smoke-552150152"}], "block_device_mapping_v2": [{"uuid": "ac2fc6e9-6334-4fb3-90b8-cc6d02f9c47f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb762368-0a84-43af-8013-3ba314096c24"}]}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:51.009116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] validate_networks() for [('cb762368-0a84-43af-8013-3ba314096c24', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:45:51.372448 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:45:51.372872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:45:51.373347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:45:51.373760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:45:51.374211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:45:51.383620 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:51.384067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:51.384870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:51.385305 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:51.401832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:45:51.405826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for user 298370ea294c4150be7de29116e49d73 and project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:45:51.464739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:45:51.466862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac2fc6e9-6334-4fb3-90b8-cc6d02f9c47f',volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:45:51.830144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:51.935179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cbc5c29d-bab4-4c6c-b4c8-2cf09b3eb26c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.040458 May 18 22:45:51.935865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 235/479] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:45:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:45:51.947465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a1510028-c6d7-46f9-867b-b53ab914d5af tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:51.948169 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a1510028-c6d7-46f9-867b-b53ab914d5af tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:52.001965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a1510028-c6d7-46f9-867b-b53ab914d5af tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:52.009490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a1510028-c6d7-46f9-867b-b53ab914d5af tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1094 microversion: 2.1 time: 0.067363 May 18 22:45:52.010544 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 245/480] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:51 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:45:53.027615 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:53.028239 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:53.034878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:53.035346 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:53.036110 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:53.036549 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:53.039513 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=53 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:45:53.103074 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:53.114659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d2a55543-ae45-4672-8ba1-58015430170d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1144 microversion: 2.1 time: 0.091974 May 18 22:45:53.115243 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 236/481] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:53 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:54.131776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:54.132386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:54.139076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:54.139553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:54.140360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:54.140794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:54.236934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:54.245750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-718e7606-1ea7-44d0-8933-abf9c2421a6a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1200 microversion: 2.1 time: 0.117857 May 18 22:45:54.246349 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 246/482] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:54 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:55.268478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:55.269213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:55.275983 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:55.276418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:55.277252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:55.277616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:55.421607 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:55.429392 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5820c073-4044-44d1-bf6f-e4c8f0084170 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1277 microversion: 2.1 time: 0.165172 May 18 22:45:55.430086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 237/483] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:55 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:55.750138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-28474a1e-16e9-4ff7-98e4-1646ebd2fdd1 req-22e5b89d-35ff-4591-8b73-ec49363f8344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f60a91a-04f2-4c00-9a6a-fa540a8b57ea", "tag": "44c157c3-379b-4597-8ca7-33a80833c6e1"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:45:55.760988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-28474a1e-16e9-4ff7-98e4-1646ebd2fdd1 req-22e5b89d-35ff-4591-8b73-ec49363f8344 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:55.761571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-28474a1e-16e9-4ff7-98e4-1646ebd2fdd1 req-22e5b89d-35ff-4591-8b73-ec49363f8344 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:55.777312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-28474a1e-16e9-4ff7-98e4-1646ebd2fdd1 req-22e5b89d-35ff-4591-8b73-ec49363f8344 service nova] Creating event network-changed:44c157c3-379b-4597-8ca7-33a80833c6e1 for instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea on hv-cinder-83800 May 18 22:45:55.781627 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-28474a1e-16e9-4ff7-98e4-1646ebd2fdd1 req-22e5b89d-35ff-4591-8b73-ec49363f8344 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036717 May 18 22:45:55.785216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 247/484] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:45:56.446988 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:56.448238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:56.456229 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:56.457152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:56.458353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:56.458949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:56.669409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:56.677233 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd5fcb55-3a6a-48de-9110-aa5a3bebaeb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.234243 May 18 22:45:56.677889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 238/485] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:56 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:57.694888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:57.695590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:57.701750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:57.702239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:57.703056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:57.703825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:57.835265 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:57.843302 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c7b02121-52e7-403c-a96a-f0a9e9e91194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.152592 May 18 22:45:57.843903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 248/486] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:57 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:45:58.860565 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:45:58.861205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:45:58.867589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:58.868698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:58.869468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:45:58.869896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:45:59.001202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:45:59.009393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3e52b15f-d236-479e-8bcd-5328a2b14aed tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.152533 May 18 22:45:59.010173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 239/487] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:45:58 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:00.026193 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:00.026843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:00.028806 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:00.033633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:00.034116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:00.034903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:00.035328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:00.170610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:00.178198 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6f4bcae9-2999-4a2d-8b42-8cd8064f05bd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.155861 May 18 22:46:00.178745 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 249/488] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:00 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:01.195552 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:01.196156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:01.202396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:01.202850 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:01.207667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:01.207667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:01.333524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:01.341301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c62aa6cf-9911-46aa-97da-25ff46a21615 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.149735 May 18 22:46:01.341866 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 240/489] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:01 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:02.358336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:02.358980 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:02.360890 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:02.365689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:02.366177 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:02.366940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:02.367375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:02.371560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=73 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:02.504393 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:02.512372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-44de39d6-d14a-4a11-8aef-2dd837f9a89a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.158850 May 18 22:46:02.513024 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 250/490] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:02 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:03.529823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:03.530464 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:03.532313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:03.532970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:03.538376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:03.538826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:03.539597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:03.540032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:03.716771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:03.724088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cb823d53-dc5d-4e1e-9b57-337577b0ba99 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.199002 May 18 22:46:03.724667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 241/491] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:03 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:04.741004 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:04.741700 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:04.749425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:04.749872 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:04.750668 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:04.751217 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:04.891160 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:04.898944 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-85c45c13-b0d9-44ef-b39c-32b03e4a4d46 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.161903 May 18 22:46:04.899679 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 251/492] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:04 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:05.916330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:05.916938 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:05.924033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:05.924474 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:05.925228 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:05.928169 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:06.066810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:06.077100 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-55fb881d-315a-433e-ad5d-b4cb955ab600 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.164496 May 18 22:46:06.077813 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 242/493] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:05 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:07.095881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:07.097272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:07.104504 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:07.105623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:07.106729 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:07.107162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:07.240692 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:07.248332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f15fecd9-763b-4564-b467-725356332769 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.157761 May 18 22:46:07.248991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 252/494] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:07 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:08.265434 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:08.265971 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:08.272455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:08.272903 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:08.273663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:08.274133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:08.404241 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:08.411605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dc75bb96-22cd-4faa-83c0-a2d8adceaf3e tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.150947 May 18 22:46:08.412177 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 243/495] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:08 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:09.428524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:09.429154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:09.435265 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:09.435708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:09.436457 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:09.436886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:09.573494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:09.598130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-951e385d-99b4-47e2-8692-cac56c338149 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.157216 May 18 22:46:09.598130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 253/496] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:09 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:10.599390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:10.599934 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:10.606672 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:10.607132 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:10.607887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:10.608325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:10.739137 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:10.747193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b12e4a77-0147-40fb-baec-a34830eb7881 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.151628 May 18 22:46:10.747757 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 244/497] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:10 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:11.763757 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:11.764355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:11.770301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:11.770744 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:11.771499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:11.771926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:11.903234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:11.910753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c0e0e4aa-e325-40bc-954f-85bcb33993a1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.150698 May 18 22:46:11.911329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 254/498] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:11 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:12.928167 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:12.928769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:12.936057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:12.936497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:12.937250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:12.937680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:13.072046 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:13.079883 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2b6a62c7-8cdb-4978-80c0-a4fd5a9eebb2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.155767 May 18 22:46:13.080450 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 245/499] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:12 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:13.831786 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-a0b828be-3af9-4ec0-8379-16723d32b109 req-11cbad96-0b43-48af-ac63-2291d1e25cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f60a91a-04f2-4c00-9a6a-fa540a8b57ea", "name": "network-vif-plugged", "status": "completed", "tag": "44c157c3-379b-4597-8ca7-33a80833c6e1"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:46:13.839935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a0b828be-3af9-4ec0-8379-16723d32b109 req-11cbad96-0b43-48af-ac63-2291d1e25cf4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:13.840376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-a0b828be-3af9-4ec0-8379-16723d32b109 req-11cbad96-0b43-48af-ac63-2291d1e25cf4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:13.851059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-a0b828be-3af9-4ec0-8379-16723d32b109 req-11cbad96-0b43-48af-ac63-2291d1e25cf4 service nova] Creating event network-vif-plugged:44c157c3-379b-4597-8ca7-33a80833c6e1 for instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea on hv-cinder-83800 May 18 22:46:13.856517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-a0b828be-3af9-4ec0-8379-16723d32b109 req-11cbad96-0b43-48af-ac63-2291d1e25cf4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028293 May 18 22:46:13.857086 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 255/500] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:46:14.096510 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:14.097147 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:14.103777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:14.104247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:14.105568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:14.106058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:14.236201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:14.243523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd89113f-2d62-4d02-a4b8-9abde017a2b2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.150909 May 18 22:46:14.244096 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 246/501] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:14 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:15.260923 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:15.261682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:15.267926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:15.268373 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:15.269162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:15.269599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:15.399125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:15.407271 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-905abcae-1110-4959-91bd-71d183713c58 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.150778 May 18 22:46:15.407842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 256/502] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:15 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:16.424231 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:16.424827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:16.431404 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:16.431847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:16.432599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:16.433664 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:16.575912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:16.583289 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b0134e50-1adf-454b-bd45-25b8630a1f28 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1265 microversion: 2.1 time: 0.162903 May 18 22:46:16.583860 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 247/503] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:16 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:17.600364 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:17.600970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:17.608230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:17.610847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:17.610847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:17.610847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:17.739388 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:17.747658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3d1919fc-5b9f-47b5-b23d-af6a4da67920 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1452 microversion: 2.1 time: 0.151049 May 18 22:46:17.748223 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 257/504] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:17 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:17.763930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:17.764468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:17.770826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:17.771267 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:17.772048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:17.772474 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:17.904961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:17.912510 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1b9531f7-5bb4-4187-8cda-0bf618d12b1d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1452 microversion: 2.1 time: 0.152377 May 18 22:46:17.913126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 248/505] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:46:17 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:46:20.001897 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-9cff0dad-4dd4-40c0-ba38-8a187923f66d req-9f78e330-707f-42c8-be86-0c4718a1caf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f60a91a-04f2-4c00-9a6a-fa540a8b57ea", "tag": "44c157c3-379b-4597-8ca7-33a80833c6e1"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:46:20.009825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-9cff0dad-4dd4-40c0-ba38-8a187923f66d req-9f78e330-707f-42c8-be86-0c4718a1caf3 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:20.010305 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-9cff0dad-4dd4-40c0-ba38-8a187923f66d req-9f78e330-707f-42c8-be86-0c4718a1caf3 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:20.022820 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-9cff0dad-4dd4-40c0-ba38-8a187923f66d req-9f78e330-707f-42c8-be86-0c4718a1caf3 service nova] Creating event network-changed:44c157c3-379b-4597-8ca7-33a80833c6e1 for instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea on hv-cinder-83800 May 18 22:46:20.028520 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-9cff0dad-4dd4-40c0-ba38-8a187923f66d req-9f78e330-707f-42c8-be86-0c4718a1caf3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030204 May 18 22:46:20.029324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 258/506] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:46:30.554163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:46:30.554787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 22:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 22:46:36.039358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:46:36.039943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Wed May 18 22:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 22:46:40.813382 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=26 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:40.814193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=77 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:41.004491 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f1214874-53c2-47a4-847e-727a49e007ee tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Action: 'create', calling method: .version_select at 0x7f6cd9091a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-33884718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2++2ae7R+ULW8Q/ZOdCD1WCKyCauI+/Cyi+KSuPTQsdCy7jHdOK8JT2y6tFKISi39HGlR/azBmyia4bzDPcnh8GavBwf+FLj0aaTb6vups0VNnCrhvqWrN5VmPI8l4KQ=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:46:41.020489 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-f1214874-53c2-47a4-847e-727a49e007ee tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Getting quotas for project 5fc1f2d036414a81ba6f2e60e8292ab6. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:46:41.024736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-f1214874-53c2-47a4-847e-727a49e007ee tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Getting quotas for user d750ba769f214a88add671cf540a49cd and project 5fc1f2d036414a81ba6f2e60e8292ab6. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:46:41.119550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f1214874-53c2-47a4-847e-727a49e007ee tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.312364 May 18 22:46:41.120176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 249/507] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:46:40 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:46:49.792685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=19 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:49.793440 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=45 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:49.797555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:49.798164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:49.804397 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:49.804840 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:49.805601 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:49.806059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:49.832074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c8863d11-02f5-4ded-b39a-142478785a3c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/ips" status: 200 len: 152 microversion: 2.20 time: 0.040279 May 18 22:46:49.832628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 259/508] 10.222.0.70 () {60 vars in 1288 bytes} [Wed May 18 22:46:49 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 22:46:53.101462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=4 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:53.102274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:46:53.106673 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:46:53.107210 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:53.115249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:53.115817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:53.116601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:53.117044 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:53.141356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lazy-loading 'flavor' on Instance uuid 8e35b912-5d2e-451c-b856-af4bb422a6c0 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:46:53.857986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-85fcf681-d0d2-4914-b71b-de879d253d9c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/action" status: 202 len: 0 microversion: 2.20 time: 0.757946 May 18 22:46:53.858626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 250/509] 10.222.0.70 () {62 vars in 1318 bytes} [Wed May 18 22:46:53 2022] POST /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 22:46:53.867982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:53.868590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:53.875031 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:53.876332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:53.877252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:53.877687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:54.123888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:54.133254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:54.134795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:54.136129 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6dfa7a2b-1ffe-4def-bf88-5f856499c068 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.272428 May 18 22:46:54.136685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 260/510] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:46:53 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:46:55.156942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:55.157821 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:55.164931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:55.165388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:55.166195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:55.166640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:55.302825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:55.310493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:55.311966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:55.314289 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-556b050e-d042-4161-b261-92778bb1923a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.162579 May 18 22:46:55.314847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 251/511] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:46:55 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:46:56.333119 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:56.333668 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:56.339572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:56.340014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:56.340787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:56.341212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:56.475091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:56.482905 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:56.484409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:56.485537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d80487f0-23f8-4577-acf0-8dcec9cdf669 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.156426 May 18 22:46:56.486102 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 261/512] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:46:56 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:46:57.504279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:57.504890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:57.511576 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:57.512030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:57.512823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:57.513262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:57.639775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:57.648198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:57.649693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:57.650865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9d5f4b33-6d48-45f5-88f2-f95c2cb94fc3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.150683 May 18 22:46:57.651428 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 252/513] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:46:57 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:46:58.669321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:58.669920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:58.676263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:58.676701 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:58.677451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:58.677879 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:58.803174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:58.811007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:58.812490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:58.814163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e428f189-b365-4aba-992a-e1000869405a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.148739 May 18 22:46:58.814710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 262/514] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:46:58 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:46:59.831785 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:46:59.832405 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:46:59.838531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:59.838974 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:59.839724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:46:59.840156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:46:59.968818 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:59.977555 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:59.979076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:46:59.980206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d950074d-14ba-4882-961d-93f5c8ca3a8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.152863 May 18 22:46:59.980772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 253/515] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:46:59 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:00.998724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:00.999324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:01.005654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:01.006342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:01.007105 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:01.007584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:01.135446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:01.143261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:01.145089 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:01.146255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7d750abf-c683-41cc-b46b-a27dee603d0e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.151329 May 18 22:47:01.146802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 263/516] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:00 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:02.164285 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:02.164897 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:02.171233 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:02.171679 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:02.173006 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:02.173569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:02.303161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:02.310985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:02.312409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:02.314416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9cf5744e-cb3a-435f-a6a9-20e3dfef3257 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.154083 May 18 22:47:02.314974 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 254/517] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:02 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:03.332874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:03.333411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:03.339409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:03.340109 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:03.340861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:03.341311 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:03.469143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:03.477398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:03.478922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:03.480052 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8c2af527-8f2c-40d4-a24b-f2d76c3514d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.151817 May 18 22:47:03.480891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 264/518] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:03 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:04.497901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:04.498554 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:04.505236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:04.505694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:04.506490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:04.506927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:04.639075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:04.647566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:04.649079 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:04.650254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3c542dd2-8233-47be-bcc1-7eb941a66cf3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.156201 May 18 22:47:04.650823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 255/519] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:04 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:05.669775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:05.670495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:05.678402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:05.678846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:05.679613 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:05.680040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:05.809609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:05.817417 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:05.818936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:05.820067 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9ed4722b-0c97-4691-85f9-a5c9310b1b5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.154203 May 18 22:47:05.820631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 265/520] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:05 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:06.838753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:06.839349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:06.845912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:06.846387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:06.847139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:06.847569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:06.979533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:06.988213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:06.989692 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:06.991014 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ed58a868-0ef6-4372-b9d5-2dc2fc157ef1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.156199 May 18 22:47:06.991576 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 256/521] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:06 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:08.009061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:08.009664 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:08.015632 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:08.016136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:08.016901 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:08.017333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:08.148126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:08.157470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:08.159462 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:08.160596 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8fe0e84d-16cb-4a35-bd15-c579d1779791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1745 microversion: 2.20 time: 0.155396 May 18 22:47:08.161151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 266/522] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:08 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:09.179300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:09.179901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:09.186447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:09.186834 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:09.187583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:09.188528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:09.316058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:09.324105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:09.325646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:09.326952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ab918728-1038-4fdb-aa90-4e0b9a237322 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1745 microversion: 2.20 time: 0.151523 May 18 22:47:09.327518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 257/523] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:09 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:09.732074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-334960093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-33884718", "security_groups": [{"name": "tempest-secgroup-smoke-577332045"}], "networks": [{"uuid": "4177bd83-4697-477b-b1d4-2aba176f602d"}], "block_device_mapping_v2": [{"uuid": "1b212823-5a2b-4031-b801-0d5676bec382", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:09.847204 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] validate_networks() for [('4177bd83-4697-477b-b1d4-2aba176f602d', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:47:09.848569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "900a1455-5a49-451d-b0db-2cff99499a2d"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:09.849899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:09.856262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:09.856998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:09.858022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:09.858497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:10.276185 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:47:10.276604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:47:10.277076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:47:10.277479 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:47:10.277885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:47:10.286816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:10.287307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:10.288110 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:10.288542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:10.306262 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Getting quotas for project 5fc1f2d036414a81ba6f2e60e8292ab6. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:47:10.310257 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Getting quotas for user d750ba769f214a88add671cf540a49cd and project 5fc1f2d036414a81ba6f2e60e8292ab6. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:47:10.368993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:47:10.371155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b212823-5a2b-4031-b801-0d5676bec382',volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:47:10.591749 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1c7cc164-85d1-4133-8cfc-7fed968cc1d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.854686 May 18 22:47:10.592413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 258/524] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:47:09 2022] POST /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:47:10.597838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:10.598685 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:10.605138 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:10.605601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:10.606406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:10.607020 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:10.742612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-95e77ab5-72ce-4ef4-8967-094a9114d0d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.014235 May 18 22:47:10.744128 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 267/525] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:47:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:47:10.758657 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-04b66ccb-6b9c-413c-aec1-033ed958d2f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:10.758657 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-04b66ccb-6b9c-413c-aec1-033ed958d2f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:10.758923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:10.767137 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:10.769003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:10.771041 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-bb626e7d-badc-457f-ae62-0709452e07b4 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1745 microversion: 2.20 time: 0.177600 May 18 22:47:10.771800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 259/526] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:10 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:10.811993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-04b66ccb-6b9c-413c-aec1-033ed958d2f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:10.818859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-04b66ccb-6b9c-413c-aec1-033ed958d2f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1086 microversion: 2.1 time: 0.067464 May 18 22:47:10.827532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 268/527] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:10 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1086 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:11.790724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:11.791334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:11.798629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:11.799084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:11.800110 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:11.800545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:11.837501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:11.838160 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:11.846741 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:11.850139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:11.850139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:11.850139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:11.929684 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:11.937474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3c69c5ed-1bfc-466f-b54b-c6ce4347b741 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1136 microversion: 2.1 time: 0.103768 May 18 22:47:11.949047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 269/528] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:11 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1136 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:11.957262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:11.965312 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:11.966863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:11.968006 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6bdf75f6-79d8-4032-ae5a-970bb1d3204a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1745 microversion: 2.20 time: 0.181175 May 18 22:47:11.968564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 260/529] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:11 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:11.998944 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-32b66b66-9eca-4ab3-9434-4b753da60b13 req-c198a3a8-6b35-425f-b208-1b12b58856ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "name": "network-vif-plugged", "status": "completed", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:12.007866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-32b66b66-9eca-4ab3-9434-4b753da60b13 req-c198a3a8-6b35-425f-b208-1b12b58856ba service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:12.008355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-32b66b66-9eca-4ab3-9434-4b753da60b13 req-c198a3a8-6b35-425f-b208-1b12b58856ba service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:12.020576 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-32b66b66-9eca-4ab3-9434-4b753da60b13 req-c198a3a8-6b35-425f-b208-1b12b58856ba service nova] Creating event network-vif-plugged:96fba53d-5676-4c31-9cb9-19ddb31ada27 for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 on hv-cinder-83800 May 18 22:47:12.025839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-32b66b66-9eca-4ab3-9434-4b753da60b13 req-c198a3a8-6b35-425f-b208-1b12b58856ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031675 May 18 22:47:12.026816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 270/530] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:47:12.955447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:12.956172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:12.962675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:12.963124 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:12.963894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:12.964330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:12.988451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:12.989063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:12.995242 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:12.995689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:12.996481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:12.996918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:13.029395 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:13.039316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7306cac3-99b4-43c4-b017-85b08f001adf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1184 microversion: 2.1 time: 0.087703 May 18 22:47:13.045914 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 261/531] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:12 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1184 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:13.192861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:13.201515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:13.203157 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:13.205196 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-287c2ec9-9f6f-4381-86a7-fc869e6a0180 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1745 microversion: 2.20 time: 0.221931 May 18 22:47:13.205833 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 271/532] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:12 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:14.057402 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:14.058865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:14.066811 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:14.067259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:14.068058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:14.068829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:14.223653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:14.224259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:14.230581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:14.231060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:14.231822 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:14.232249 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:14.265337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:14.273249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c45d3a81-a338-4966-8af7-95af843d1f50 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1269 microversion: 2.1 time: 0.219701 May 18 22:47:14.273827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 262/533] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:14 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:14.434496 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:14.443206 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:14.444707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:14.445858 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c6939daa-031a-459b-baa9-3982fae514f7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1745 microversion: 2.20 time: 0.226200 May 18 22:47:14.446446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 272/534] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:14 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:15.124206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-12da6921-efeb-4346-8094-b4c73d794eeb req-52409010-a93b-439c-ba75-f282ac2886c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:15.131591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-12da6921-efeb-4346-8094-b4c73d794eeb req-52409010-a93b-439c-ba75-f282ac2886c0 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:15.132172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-12da6921-efeb-4346-8094-b4c73d794eeb req-52409010-a93b-439c-ba75-f282ac2886c0 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:15.136563 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:15.145523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-12da6921-efeb-4346-8094-b4c73d794eeb req-52409010-a93b-439c-ba75-f282ac2886c0 service nova] Creating event network-changed:60d9c274-368f-4afe-81d6-9735f604892c for instance c850c82e-2876-4797-8a76-d09960544a2f on hv-cinder-83800 May 18 22:47:15.150447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-12da6921-efeb-4346-8094-b4c73d794eeb req-52409010-a93b-439c-ba75-f282ac2886c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105738 May 18 22:47:15.153936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 263/535] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:47:15.290029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:15.290647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:15.296695 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:15.297683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:15.298638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:15.299079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:15.465271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:15.466438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:15.477498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:15.477959 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:15.478954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:15.479407 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:15.505644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:15.513949 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2e7463f0-3052-4407-9e50-ed92061580c1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1269 microversion: 2.1 time: 0.227820 May 18 22:47:15.517267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 273/536] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:15 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:15.728422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:15.737202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:15.738852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:15.740008 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c2f5c92d-2f9a-41c6-887b-107c203beb7a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.279092 May 18 22:47:15.740575 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 264/537] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:15 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:16.530967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:16.532878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:16.539925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:16.540618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:16.541400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:16.541837 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:16.738804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:16.747756 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-95266be3-3b09-427d-80c2-6856a5840bf8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1269 microversion: 2.1 time: 0.221154 May 18 22:47:16.748330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 274/538] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:16 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1269 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:16.758278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:16.758947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:16.765768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:16.767387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:16.768180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:16.768617 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:16.907311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:16.917499 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:16.919346 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:16.920638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5795f068-f9c3-4792-870e-04bc0751d178 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.166243 May 18 22:47:16.921307 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 265/539] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:16 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:17.765197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:17.766111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:17.773838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:17.774303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:17.775061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:17.775488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:17.922782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:17.931430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d7c30231-a982-4909-85db-87ef2c2a07cb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1269 microversion: 2.1 time: 0.170628 May 18 22:47:17.932356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 275/540] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:17 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:17.945924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:17.946585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:17.954875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:17.955580 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:17.956349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:17.956777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:18.101619 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:18.110695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:18.112460 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:18.113800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d807f871-6277-4e0b-8317-0f285ac29f8a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.171718 May 18 22:47:18.114562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 266/541] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:17 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:18.948677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:18.949483 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:18.958620 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:18.959070 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:18.959909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:18.960346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:19.130332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:19.134682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:19.135359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:19.139007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ae71107f-63b7-419e-b645-2c1f0b8f28df tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1269 microversion: 2.1 time: 0.194478 May 18 22:47:19.140118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 276/542] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:18 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:19.154840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:19.159241 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:19.159241 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:19.159241 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:19.279877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:19.281966 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:19.288676 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:19.289159 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:19.289918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:19.290422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:19.321233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'flavor' on Instance uuid d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:47:19.329332 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:19.337890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:19.340340 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:19.341252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:19.342445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8832c389-3564-4313-82cb-ec559984d7e1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.213593 May 18 22:47:19.343304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 267/543] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:19 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:19.887412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9c567b5c-4793-481d-8c07-94325105213a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/action" status: 200 len: 32 microversion: 2.1 time: 0.611220 May 18 22:47:19.888197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 277/544] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:47:19 2022] POST /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/action => generated 32 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:47:19.899880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:19.900644 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:19.908693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:19.912567 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:19.913524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:19.913973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:20.124056 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:20.133916 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2fea4bdc-abed-48f2-b243-914de634547e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.239573 May 18 22:47:20.135272 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 268/545] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:19 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:20.158750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:20.160230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:20.162372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:20.168984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:20.172788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:20.172788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:20.172788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:20.296495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:20.363739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:20.364706 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:20.373755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:20.387701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:20.387701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:20.387701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:20.428207 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:20.440730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ce07a49d-6823-4977-a232-ab5e7b161a3a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1269 microversion: 2.1 time: 0.283624 May 18 22:47:20.441336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 278/546] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:20 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1269 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:20.562642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:20.571614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:20.574103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:20.574340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-40af67c8-4ddd-45d4-8e18-cb8ebd202174 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.217082 May 18 22:47:20.574894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 269/547] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:20 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:21.152721 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:21.153439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:21.155379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=8 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:21.160923 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:21.161537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:21.162073 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:21.162528 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:21.309078 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:21.317902 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-55aa85d9-1171-4610-a036-0648e95efa18 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.168974 May 18 22:47:21.318488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 279/548] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:21 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:21.458505 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:21.459188 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:21.466790 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:21.467486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:21.468436 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:21.469051 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:21.594924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:21.595808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:21.602921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:21.603365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:21.604330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:21.604763 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:21.610967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:21.620016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-42938e7c-a7a5-4a85-9106-83ca1fb09b75 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.166080 May 18 22:47:21.620927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 270/549] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:21 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:21.831977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:21.843663 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:21.845620 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:21.849344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-98277e79-7dd5-4ad8-aeec-0b6f24ec0b1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.256768 May 18 22:47:21.860595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 280/550] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:21 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:22.335932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:22.336446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:22.342856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:22.343296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:22.344057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:22.344487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:22.494806 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:22.503733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-32ce653b-ce02-4cea-abdd-687de6a1ba66 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.171597 May 18 22:47:22.504321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 271/551] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:22 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:22.640623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:22.641816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:22.649506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:22.650205 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:22.651151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:22.651866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:22.804786 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:22.812589 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ed51515e-2961-472a-8786-e425108cb5a0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.177862 May 18 22:47:22.813466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 281/552] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:22 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:22.868220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:22.868828 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:22.876777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:22.876777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:22.877212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:22.878418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:23.023205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:23.031755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:23.033253 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:23.034530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e83cd014-55ea-4f14-b2bf-4a453ba588b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.170239 May 18 22:47:23.035120 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 272/553] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:22 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:23.521476 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:23.522113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:23.528145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:23.528590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:23.529345 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:23.529773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:23.661478 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:23.669317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2abc8ae9-510f-4822-9d2d-5b59757d32b3 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.151982 May 18 22:47:23.670936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 282/554] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:23 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:23.830774 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:23.831390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:23.834274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=47 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:23.841183 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:23.842158 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:23.842691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:23.843200 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:23.988372 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:23.996535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-84f71c6f-ab64-44a0-bc7c-5066f31b5bbd tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.169966 May 18 22:47:23.998198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 273/555] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:23 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:24.053644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:24.054330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:24.061261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:24.061821 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:24.062699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:24.063610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:24.215568 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:24.231500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:24.233678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:24.234877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-41c2f2e1-7bbe-4371-9bfe-1d0023611950 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.186038 May 18 22:47:24.235751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 283/556] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:24 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:24.687872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:24.688397 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:24.694830 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:24.696007 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:24.696007 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:24.696488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:24.840657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:24.850428 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7250bb47-d164-4666-873a-6aa73c7d46ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.166587 May 18 22:47:24.854610 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 274/557] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:24 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:25.014490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:25.015172 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:25.022467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:25.022919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:25.023702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:25.024138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:25.170513 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:25.178747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f0ba935f-a961-4640-9c6c-195932081c14 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.168529 May 18 22:47:25.182773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 284/558] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:25 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:25.254439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:25.255070 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:25.261238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:25.261698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:25.262926 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:25.263146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:25.414823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:25.425224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:25.426828 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:25.427997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-429479a5-b0bf-4078-85a1-0e41c0ec29ca tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.178033 May 18 22:47:25.428559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 275/559] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:25 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:25.869520 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:25.870241 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:25.876541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:25.876978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:25.877739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:25.878199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:26.019524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:26.028054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d6b3adb3-0cee-41e4-ae1e-b81b6d7c5d58 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.162256 May 18 22:47:26.031297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 285/560] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:25 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:26.195763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:26.196429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:26.202991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:26.203659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:26.204599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:26.205080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:26.343063 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:26.351398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-13aef5bb-63ed-4302-8d6b-23f99a2c9be5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.159384 May 18 22:47:26.351987 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 276/561] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:26 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:26.448554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:26.449566 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:26.457284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:26.458107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:26.458998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:26.459466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:26.614088 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:26.624854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:26.626468 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:26.628748 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-db1566ea-99e1-4a31-98fc-be60aa165fa9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.183677 May 18 22:47:26.629929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 286/562] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:26 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:27.048588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:27.049446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:27.055556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:27.056004 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:27.056765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:27.057197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:27.192337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:27.200630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-15029980-6a8d-4742-9df4-3a63771a486e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.155885 May 18 22:47:27.201272 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 277/563] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:27 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:27.368231 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:27.368823 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:27.375255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:27.375551 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:27.376325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:27.376762 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:27.522033 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:27.529609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a115438-8a0e-41bc-8010-5455b8276916 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.165355 May 18 22:47:27.530506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 287/564] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:27 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:27.647631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:27.648237 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:27.654700 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:27.655148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:27.655909 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:27.656343 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:27.806528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:27.815919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:27.818078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:27.820126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6b7a3001-84ad-43d9-8529-e64ae2b0cb14 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.176509 May 18 22:47:27.820933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 278/565] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:27 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:28.217951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:28.218617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:28.225503 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:28.225942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:28.226797 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:28.227226 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:28.357663 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:28.365608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-143e265c-436a-4924-97d3-431ea012e186 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.151628 May 18 22:47:28.366195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 288/566] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:28 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:28.546958 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:28.547577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:28.554028 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:28.554509 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:28.555279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:28.555718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:28.687901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:28.695822 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ef028ba0-b719-4b22-84fb-29b32d84d489 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.152720 May 18 22:47:28.696387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 279/567] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:28 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:28.840537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:28.841119 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:28.847234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:28.847682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:28.848430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:28.848860 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:28.974897 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:28.982711 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:28.984195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:28.985321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d8b7bf50-2b39-4233-b06c-59400ff55691 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1740 microversion: 2.20 time: 0.148643 May 18 22:47:28.985876 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 289/568] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:28 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:29.382190 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:29.385146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:29.391188 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:29.391635 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:29.392404 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:29.392839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:29.411794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:29.525775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:29.534487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-df8bdb84-b36a-44f6-ae6f-45d96bda1ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.155746 May 18 22:47:29.537984 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 280/569] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:29 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:29.712952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:29.713553 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:29.719780 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:29.720173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:29.720920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:29.722087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:29.938560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:29.948294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a3590122-e56c-48a3-bbdb-9dfb7b72ebc8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.239220 May 18 22:47:29.949003 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 290/570] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:29 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:30.003973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:30.004747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:30.012729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:30.013371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:30.014809 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:30.015542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:30.237473 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:30.246290 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:30.247954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:30.249133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ba3d0563-b080-4269-bf9e-2977bd7c38f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1722 microversion: 2.20 time: 0.249260 May 18 22:47:30.259191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 281/571] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:29 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:30.552341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:30.552878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:30.558992 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:30.559435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:30.560182 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:30.560610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:30.687969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:30.695924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-45846fee-792c-45d8-947c-c9bda995bc2c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.147865 May 18 22:47:30.696479 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 291/572] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:30 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:30.966635 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:30.967359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:30.974123 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:30.974647 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:30.975419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:30.975856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:31.104297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:31.111705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c1e3c714-067c-45d0-901d-964638037d58 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.149648 May 18 22:47:31.112968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 282/573] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:30 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:31.267961 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:31.268489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:31.275227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:31.275671 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:31.276414 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:31.276840 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:31.405819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:31.409170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:31.419991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:31.421467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:31.422653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-05827774-6005-4522-96db-4e8a6852b791 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1722 microversion: 2.20 time: 0.158663 May 18 22:47:31.429247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 292/574] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:31 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:31.713600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:31.714244 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:31.720194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:31.720644 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:31.721424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:31.721853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:31.846992 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:31.854912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4f5c0fb5-2766-4ee1-a8b4-c88800b5f87a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.145224 May 18 22:47:31.855490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 283/575] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:31 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:32.129693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:32.130194 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:32.136541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.136987 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:32.137753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.138229 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:32.273721 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:32.281735 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c62688ea-5fdd-44b2-b957-9d56a03e99d5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.156385 May 18 22:47:32.282336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 293/576] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:32 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:32.361321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-6cc1171f-b0ee-4f2d-8561-76471edf2d13 req-e26f3dd3-f7bf-4ed1-b8ff-98d38338dbf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "name": "network-vif-plugged", "status": "completed", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:32.369498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-6cc1171f-b0ee-4f2d-8561-76471edf2d13 req-e26f3dd3-f7bf-4ed1-b8ff-98d38338dbf7 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.371004 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-6cc1171f-b0ee-4f2d-8561-76471edf2d13 req-e26f3dd3-f7bf-4ed1-b8ff-98d38338dbf7 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:32.381634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-6cc1171f-b0ee-4f2d-8561-76471edf2d13 req-e26f3dd3-f7bf-4ed1-b8ff-98d38338dbf7 service nova] Creating event network-vif-plugged:60d9c274-368f-4afe-81d6-9735f604892c for instance c850c82e-2876-4797-8a76-d09960544a2f on hv-cinder-83800 May 18 22:47:32.387071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-6cc1171f-b0ee-4f2d-8561-76471edf2d13 req-e26f3dd3-f7bf-4ed1-b8ff-98d38338dbf7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085325 May 18 22:47:32.387705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 284/577] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:47:32.446290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:32.447376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:32.454405 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.454851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:32.455672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.456101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:32.590379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:32.599483 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:32.601341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:32.602537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eed2731e-3ccf-4115-afa6-cf1dd9741a08 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1722 microversion: 2.20 time: 0.160440 May 18 22:47:32.603274 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 294/578] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:32 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:32.871862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:32.872493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:32.879380 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.879834 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:32.880663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:32.881082 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:33.010116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:33.018312 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b41371c3-2f3e-410f-8188-6156f3bc2fef tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.150710 May 18 22:47:33.018886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 285/579] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:32 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:33.299330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:33.299939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:33.306956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:33.307399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:33.308146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:33.308574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:33.437030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:33.444463 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9112948e-7da9-43c3-a8d5-b23705c6e603 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.149195 May 18 22:47:33.445029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 295/580] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:33 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:33.620782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:33.621390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:33.627859 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:33.628319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:33.629082 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:33.629519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:33.757851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:33.765658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:33.767186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:33.768331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fce3e382-1fd1-42fe-8443-6ee795076e99 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1725 microversion: 2.20 time: 0.151533 May 18 22:47:33.769392 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 286/581] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:33 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:33.786773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "027b8bbc-39f6-4907-bf76-911ac3300ad5"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:33.787897 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:33.793851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:33.794336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:33.795087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:33.795516 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.035642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:34.036283 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:34.042467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.042935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.043690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.044125 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.208866 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:34.218160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9fc3557c-c8a9-45d7-b5c7-13493a2144ed tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.186475 May 18 22:47:34.219002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 287/582] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:34 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:34.404416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-cc2ae708-a080-4cfc-a765-6ade362e47f9 req-291bf85c-2da7-41c5-bff6-23ab74579c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "name": "network-vif-unplugged", "status": "completed", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:34.413527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-cc2ae708-a080-4cfc-a765-6ade362e47f9 req-291bf85c-2da7-41c5-bff6-23ab74579c66 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.414097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-cc2ae708-a080-4cfc-a765-6ade362e47f9 req-291bf85c-2da7-41c5-bff6-23ab74579c66 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.426148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.compute.server_external_events [req-cc2ae708-a080-4cfc-a765-6ade362e47f9 req-291bf85c-2da7-41c5-bff6-23ab74579c66 service nova] Unable to find a host for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0. Dropping event network-vif-unplugged {{(pid=124366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 18 22:47:34.427047 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-cc2ae708-a080-4cfc-a765-6ade362e47f9 req-291bf85c-2da7-41c5-bff6-23ab74579c66 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026708 May 18 22:47:34.427630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 288/583] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 22:47:34.461812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:34.462340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:34.468542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.468993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.469753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.470236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.604297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:34.611706 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-31b3f432-5a43-4be8-94a0-9aeb3130bcc1 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1257 microversion: 2.1 time: 0.154141 May 18 22:47:34.612324 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 289/584] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:34 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:34.735234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3475d7df-8c44-4c3e-bb16-2f221822dff0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.952906 May 18 22:47:34.735787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 296/585] 10.222.0.70 () {62 vars in 1363 bytes} [Wed May 18 22:47:33 2022] POST /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments => generated 188 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:47:34.848189 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:34.848747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:34.855180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.855622 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:34.856406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:34.856842 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.079311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ed932f90-310c-4b8e-a4c4-3366a1e3cade tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/action" status: 202 len: 0 microversion: 2.20 time: 0.235073 May 18 22:47:35.079966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 290/586] 10.222.0.70 () {62 vars in 1318 bytes} [Wed May 18 22:47:34 2022] POST /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 22:47:35.088345 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:35.088937 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:35.094929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.095379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.096144 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.096573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.239618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:35.240240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:35.246717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.247470 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.248441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.248968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.515466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:35.524240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:35.525739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:35.526894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2c78b189-ce74-4809-86a9-e6ed4cd564f9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1751 microversion: 2.20 time: 0.442641 May 18 22:47:35.527550 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 297/587] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:35 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1751 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:35.563138 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:35.571174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-aa6f51ca-20a2-4505-8898-f4084aecec08 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.336970 May 18 22:47:35.571674 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 291/588] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:35 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:35.628563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:35.629273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:35.635478 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.635997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.636824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.637441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.779432 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:35.787812 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f2bab513-f2f9-4665-80ac-adaed097cd67 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1441 microversion: 2.1 time: 0.163092 May 18 22:47:35.788453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 298/589] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:35 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:35.805152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:35.805758 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:35.812406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.812877 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.813652 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:35.814122 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:35.962573 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:35.962573 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ce410c14-011c-4421-9836-16daf142b0f0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1441 microversion: 2.1 time: 0.160642 May 18 22:47:35.963360 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 292/590] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:35 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1441 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:36.546147 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:36.550890 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:36.554057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:36.554536 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:36.555302 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:36.555738 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:36.587759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:36.588659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:36.595107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:36.596088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:36.597653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:36.598215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:36.877779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:36.886846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:36.888354 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:36.889522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-248226ee-8565-46bf-a63d-281748b0058d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1751 microversion: 2.20 time: 0.347353 May 18 22:47:36.890102 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 299/591] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:36 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1751 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:36.920307 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:36.929078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fd23c3d4-2d07-4f76-a5ec-5180711c50dc tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.345148 May 18 22:47:36.929933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 293/592] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:36 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:37.909364 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:37.910600 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:37.916708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:37.917162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:37.917925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:37.918409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:37.946199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:37.946930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:37.953861 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:37.954408 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:37.955446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:37.955948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:38.205960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:38.217344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:38.218851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:38.223131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-89dab19d-e5d2-4109-80d6-d0b10a256718 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1753 microversion: 2.20 time: 0.314665 May 18 22:47:38.223131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 300/593] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:37 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1753 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:38.237276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:38.245927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b1ae2abe-d7c1-4e20-aca6-0bba1e63e4db tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.303800 May 18 22:47:38.246520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 294/594] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:37 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:38.339174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-cf9f293e-c0e9-4f8a-9221-a91cd068c9ca req-7fc81b70-998c-4f18-8edd-a9df6199059d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:38.347825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-cf9f293e-c0e9-4f8a-9221-a91cd068c9ca req-7fc81b70-998c-4f18-8edd-a9df6199059d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:38.348412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-cf9f293e-c0e9-4f8a-9221-a91cd068c9ca req-7fc81b70-998c-4f18-8edd-a9df6199059d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:38.359230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-cf9f293e-c0e9-4f8a-9221-a91cd068c9ca req-7fc81b70-998c-4f18-8edd-a9df6199059d service nova] Creating event network-changed:60d9c274-368f-4afe-81d6-9735f604892c for instance c850c82e-2876-4797-8a76-d09960544a2f on hv-cinder-83800 May 18 22:47:38.365205 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-cf9f293e-c0e9-4f8a-9221-a91cd068c9ca req-7fc81b70-998c-4f18-8edd-a9df6199059d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029768 May 18 22:47:38.365959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 301/595] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:47:39.238954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:39.239552 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:39.246053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:39.246504 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:39.247260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:39.247692 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:39.263601 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:39.264304 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:39.271809 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:39.272265 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:39.273056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:39.273681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:39.540220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:39.550771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:39.553016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:39.554232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b2b0b2f0-4812-4333-84ac-238a9273cfd8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1753 microversion: 2.20 time: 0.319165 May 18 22:47:39.554800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 295/596] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:39 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1753 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:39.561063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:39.569860 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eff70545-01a0-4545-b315-1e39b69021a9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.310405 May 18 22:47:39.570475 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 302/597] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:39 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:40.572563 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:40.573173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:40.579860 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:40.580304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:40.581071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:40.582197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:40.587368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:40.587978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:40.594037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:40.594477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:40.595448 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:40.595882 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:40.871487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:40.881432 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:40.893611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:40.893817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:40.894467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ceb0fc31-99e2-4e10-ba30-ef1ab3c26a1e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1753 microversion: 2.20 time: 0.316064 May 18 22:47:40.894467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 296/598] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:40 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1753 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:40.894638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aba1eee1-3c23-4751-9ac8-28c6d9afb30b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1737 microversion: 2.1 time: 0.308179 May 18 22:47:40.894638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 303/599] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:40 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:41.903645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:41.904416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:41.909579 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:41.910640 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:41.911788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:41.912519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:41.914158 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:41.914989 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:41.916698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:41.917154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:41.917921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:41.918562 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:41.935086 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:42.415880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:42.424386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:42.426490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:42.427648 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9d613c88-c508-46dd-a133-010c65b84056 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.527885 May 18 22:47:42.428216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 297/600] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:41 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:42.438169 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:42.446464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bbeb0c16-c752-4e10-b38f-12e88cd01607 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1717 microversion: 2.1 time: 0.540692 May 18 22:47:42.447076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 304/601] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:41 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1717 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:42.503214 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:42.506916 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:42.509846 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:42.510362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:42.511120 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:42.511553 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:42.637026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] HTTP exception thrown: Cannot 'detach_volume' instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 while it is in vm_state rescued May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Request method failure captured: May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments/900a1455-5a49-451d-b0db-2cff99499a2d HTTP/1.1 May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYbjbQ_ZECXKziv0DZA2jsqDVXSP0EvU9dofmfutAYSWvDZ81U29vslocOQviFQ316tWoKBt7Od5qL1GEX7Hynj86iWvdoINgd-2xRnIap59pJ9KS4mUSM4YamWixkWBcVmES0W5IxsL_ag2L4ho9fS-O55lcqVreepKfvdP0j2q0s May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:47:42.638675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c184ebb6e93a4cd58d65d8fbe43c4760", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c184ebb6e93a4cd58d65d8fbe43c4760"}]}] May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: be51e8b84bb7471bb17409b331e599eb May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:47:42.640053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Cannot 'detach_volume' instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 while it is in vm_state rescued May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'server_id': 'd0c0219f-b3e3-4a3c-98fa-247fb1d60b69', 'id': '900a1455-5a49-451d-b0db-2cff99499a2d'} May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:47:42.640882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 while it is in vm_state rescued May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 while it is in vm_state rescued May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:42.642415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Returning 409 to user: Cannot 'detach_volume' instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 while it is in vm_state rescued {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:47:42.643609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-47a6b36e-0b9d-4655-a5f5-edc0715e3b7b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments/900a1455-5a49-451d-b0db-2cff99499a2d" status: 409 len: 152 microversion: 2.1 time: 0.141083 May 18 22:47:42.643609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 298/602] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:47:42 2022] DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments/900a1455-5a49-451d-b0db-2cff99499a2d => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 22:47:42.649662 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:42.650327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:42.656380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:42.656905 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:42.657759 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:42.658325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:42.813609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-63796b06-b004-4858-91eb-1f6cfe2a1085 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "POST /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/action" status: 202 len: 0 microversion: 2.1 time: 0.167573 May 18 22:47:42.814268 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 305/603] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:47:42 2022] POST /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:47:42.822497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:42.823677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:42.829893 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:42.830606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:42.832091 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:42.832717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:42.972315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:42.980202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ffcb026a-e2cc-4aab-ba28-12d75bef085b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.161529 May 18 22:47:42.980762 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 299/604] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:42 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:43.447845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:43.448729 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:43.468862 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:43.470180 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:43.475027 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:43.475559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:43.506563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:43.660690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:43.670521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:43.674965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:43.674965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9ecbdbd7-6a7a-4232-8205-4e8a6c3eed2e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.230157 May 18 22:47:43.675284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 306/605] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:43 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:43.999034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:43.999574 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:44.006628 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:44.007071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:44.007827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:44.008254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:44.146363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:44.154893 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd9d70d8-a2e7-4c66-9847-fcf0616b5176 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.159928 May 18 22:47:44.155463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 300/606] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:43 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:44.692372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:44.693053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:44.700292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:44.701083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:44.702124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:44.702774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:44.840856 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:44.850573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:44.852065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:44.853225 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-75fc9f35-52ed-4a94-848a-58f4a8cd5b35 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.165491 May 18 22:47:44.853782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 307/607] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:44 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:45.172622 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:45.173225 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:45.180292 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:45.180742 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:45.181515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:45.182105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:45.322527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:45.330630 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b686e3e4-5c8e-4282-8d89-94b59b266e7d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.161817 May 18 22:47:45.341736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 301/608] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:45 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:45.873466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:45.874267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:45.883282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:45.884092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:45.884940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:45.885433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:46.038550 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:46.050896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:46.054355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:46.055547 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e20ccbd7-db03-4cf1-b0b7-51a5a26001df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.186579 May 18 22:47:46.056112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 308/609] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:45 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:46.349222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:46.349222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:46.356129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:46.356653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:46.357350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:46.357784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:46.503740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:46.510663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-feb4e75d-e3a6-4661-8387-78ea84a2cbfd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.165888 May 18 22:47:46.511233 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 302/610] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:46 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:47.075000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:47.075639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:47.082489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.082942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.083722 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.084158 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.220960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:47.230750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:47.232231 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:47.233383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-70626bfb-f368-4ebe-9f33-b10644df6bb6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.162328 May 18 22:47:47.234161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 309/611] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:47 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:47.528021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:47.529931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:47.535755 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.536226 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.537494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.537921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.652201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:47.652770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:47.660234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.660888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.661662 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.662356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.689060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-73479a75-7229-4b83-a19b-d9904cf69d29 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/ips" status: 200 len: 149 microversion: 2.1 time: 0.177805 May 18 22:47:47.695890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 303/612] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:47:47 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/ips => generated 149 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:47:47.701368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:47:47.702381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:47.702525 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:47.709789 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.710327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.711105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.711585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.711709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9499eebd-9359-4ad7-aadb-978acb3138b4 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.187321 May 18 22:47:47.713433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 310/613] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:47 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:47.799853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Invalid volume: volume 9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe is already attached to instances: 097a1c9f-e116-4327-a473-ab82fe379d7f May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: POST /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/os-volume_attachments HTTP/1.1 May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 74 May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:47:47.801831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {"volumeAttachment": {"volumeId": "9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe"}} May 18 22:47:47.803902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Invalid volume: volume 9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe is already attached to instances: 097a1c9f-e116-4327-a473-ab82fe379d7f May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'server_id': '11859bc6-9f40-4ebd-a362-f02edc56387f', 'body': {'volumeAttachment': {'volumeId': '9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe'}}} May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe is already attached to instances: 097a1c9f-e116-4327-a473-ab82fe379d7f May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:47.804996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe is already attached to instances: 097a1c9f-e116-4327-a473-ab82fe379d7f May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:47:47.806825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe is already attached to instances: 097a1c9f-e116-4327-a473-ab82fe379d7f May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 400 to user: Invalid volume: volume 9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe is already attached to instances: 097a1c9f-e116-4327-a473-ab82fe379d7f {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-78909709-e984-4074-88f2-567503ce4b5a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105955 May 18 22:47:47.808820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 304/614] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:47:47 2022] POST /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 18 22:47:47.812701 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:47.813198 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:47.819600 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.820040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.820821 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:47.821249 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:47.847439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:47:48.181130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3e150e46-ef57-40d1-9350-a9d54fc76c62 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 204 len: 0 microversion: 2.1 time: 0.372253 May 18 22:47:48.182499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 311/615] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:47:47 2022] DELETE /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 22:47:48.190034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:48.193001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:48.197473 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:48.197928 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:48.198728 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:48.199166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:48.253574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:48.254338 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:48.260703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:48.261203 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:48.262132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:48.262572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:48.404851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:48.413723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-60aa2846-1b22-45ac-b944-b4ccdb2693a0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.227517 May 18 22:47:48.414661 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 305/616] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:48 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:48.435421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:48.443947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:48.445526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:48.446704 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c8d7318b-8215-478c-8154-8bf6e1f9a864 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.197781 May 18 22:47:48.447495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 312/617] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:48 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:48.730887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:48.731500 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:48.738116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:48.738571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:48.739334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:48.739769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:48.879087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:48.887992 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-68b7b8bb-034e-4694-81f9-5c5aed86703b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.160784 May 18 22:47:48.888735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 306/618] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:48 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:49.437795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:49.438481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:49.444894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:49.445343 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:49.446240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:49.446799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:49.465391 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:49.466018 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:49.482644 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:49.483238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:49.487333 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:49.487827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:49.678317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:49.681351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:49.688447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:49.688762 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-261ed3e7-33c9-405d-86f0-37163cc7f530 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.254787 May 18 22:47:49.689519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 313/619] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:49 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:49.690113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:49.692068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2657ac34-6b4d-407e-bfea-82430ca4c787 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.231247 May 18 22:47:49.699665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 307/620] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:49 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:49.906470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:49.913320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:49.913320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:49.913567 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:49.914336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:49.914764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:50.063336 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:50.072092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e815769a-1584-42f2-b97b-bbc796a8f20f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.169643 May 18 22:47:50.072667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 314/621] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:49 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:47:50.708178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:50.708769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:50.711449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:50.712069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:50.714339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:50.715662 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:50.716124 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:50.716918 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:50.717355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:50.719932 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:50.720385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:50.721150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:50.721683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:50.924080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:50.931423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:50.932284 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8c0778ac-b183-4357-852c-4b025b164dd4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.229057 May 18 22:47:50.932854 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 308/622] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:50 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:50.939775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:50.941881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:50.943378 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-958a4f17-f9e3-41cc-bca8-0809b59a4d6e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.236158 May 18 22:47:50.943932 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 315/623] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:50 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:51.088727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:51.089334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:51.095431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:51.095927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:51.097708 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:51.098176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:51.232375 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:51.240387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-97767415-ec8c-4837-a006-980bf0bc906a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.155547 May 18 22:47:51.240949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 309/624] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:51 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:51.950540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:51.951153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:51.957575 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:51.958048 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:51.958938 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:51.959375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:51.960579 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:51.961347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:51.968300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:51.968749 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:51.969519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:51.969960 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:52.173468 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:52.175364 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:52.185190 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-893d9923-3ac0-429b-bd38-1a9d4bdc2679 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.238376 May 18 22:47:52.193100 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 316/625] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:51 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:52.193311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:52.194781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:52.196010 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-217c10d0-79c1-46b8-b03e-6f0a15e824bb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.239454 May 18 22:47:52.196716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 310/626] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:51 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:52.257416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:52.258217 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:52.264584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:52.265187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:52.265954 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:52.266425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:52.409751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:52.418291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-14a63221-517b-4ab9-8336-acc1d7abfe3e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.164603 May 18 22:47:52.428979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 317/627] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:52 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:53.209094 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:53.214378 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:53.215006 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:53.218570 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:53.223427 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:53.223975 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:53.224961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:53.225222 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:53.225414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:53.225799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:53.226219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:53.226690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:53.434947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:53.443201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c9404b63-f48f-4d90-8944-ba7f0f7b5697 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.239091 May 18 22:47:53.443880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 311/628] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:53 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:53.449100 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:53.449788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:53.453249 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:53.456317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:53.456777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:53.457563 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:53.458024 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:53.465218 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:53.466968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:53.474167 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-45233232-7270-4223-95f1-d998c53d3f5d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.257804 May 18 22:47:53.475013 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 318/629] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:53 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:47:53.598690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:53.607002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-38695dd9-8896-448a-b424-6c61f24161cd tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.162002 May 18 22:47:53.608025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 312/630] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:53 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:54.462113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:54.462720 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:54.469334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:54.469780 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:54.470574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:54.471008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:54.492806 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:54.493412 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:54.495730 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=82 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:54.500710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:54.501159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:54.501930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:54.502390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:54.710529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:54.718424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:54.718906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-884a2942-1fae-4e56-838f-1738b1dbc978 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.260900 May 18 22:47:54.719503 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 319/631] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:54 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:54.725624 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:54.726519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:54.727658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:54.729157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:54.730379 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1ed39d62-99ee-4382-86df-c82bbe5b77f2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.241502 May 18 22:47:54.730942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 313/632] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:54 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:54.736797 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:54.737314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:54.738290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:54.738734 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:54.880144 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:54.888077 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8b4ee383-7c36-48d2-95ab-6784746fce0e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.167623 May 18 22:47:54.888658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 320/633] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:54 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:55.736479 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:55.737621 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:55.744326 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:55.744773 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:55.745528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:55.745956 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:55.749754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:55.750401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:55.757140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:55.757585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:55.758384 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:55.758843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:55.765931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:55.776723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:47:55.946519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:55.950382 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:55.954569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0581c2a2-f96c-4fbc-8bd6-9166f5dbaaa3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.221799 May 18 22:47:55.955147 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 314/634] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:55 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:55.958982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:55.959702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:55.960305 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:55.960478 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:55.961611 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3e0958ab-88df-4cc9-a8d4-fbdf6aeafca1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.215693 May 18 22:47:55.962357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 321/635] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:55 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:55.966612 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:55.967064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:55.967837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:55.968274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:56.099926 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:56.107738 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-498c35b8-4ec4-426f-a348-21143431891f tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.151668 May 18 22:47:56.108296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 315/636] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:55 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:56.972427 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:56.973032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:56.979259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:56.979710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:56.980453 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:56.980855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:56.980953 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:56.981070 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:56.987638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:56.988089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:56.988842 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:56.989272 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:57.253900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:57.258954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:57.263334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6417ca24-3f18-4130-b8d5-fde1d6dcc444 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.294693 May 18 22:47:57.264013 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 322/637] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:56 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:57.267571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:57.269175 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:57.269529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:57.270188 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:57.270523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-17b2d125-cec5-430f-8db6-7f7a55110e60 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.293977 May 18 22:47:57.271255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 316/638] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:56 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:57.276416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:57.276866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:57.277640 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:57.278099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:57.415027 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:57.422840 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4a270977-b93f-401d-be9d-530fb58be806 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.157264 May 18 22:47:57.423411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 323/639] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:57 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:58.280937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:58.281475 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:58.288254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:58.288589 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:58.289032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:58.289251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:58.289434 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:58.289864 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:58.295399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:58.295846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:58.296608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:58.297044 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:58.487268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:58.487430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:58.490398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8ecd7a9b-bb6e-4f6a-8677-48567f65356c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.213331 May 18 22:47:58.490964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 317/640] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:58 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:58.495391 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:58.495538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:58.495983 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:58.497158 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:58.498659 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-773a86e1-81b0-4791-9b79-a83ed1c9123e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.213965 May 18 22:47:58.499049 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 324/641] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:58 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:58.502094 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:58.502541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:58.503942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:58.504373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:58.631077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:58.639105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-35574c40-f65a-4572-b653-0ac4e5a3da0a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.147221 May 18 22:47:58.639667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 318/642] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:58 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:59.508953 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:59.509614 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:59.515847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:59.516292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:59.516593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:59.517056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:59.517198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:59.517486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:59.523847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:59.524292 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:59.525108 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:59.525550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:59.709106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:59.716473 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f48f898b-00a5-4e4d-b192-3789488ded9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.211385 May 18 22:47:59.717054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 325/643] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:59 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:47:59.721881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:47:59.722517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:47:59.724319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:59.728410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:59.728857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:59.729613 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:47:59.730071 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:47:59.733090 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:59.734603 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:59.735798 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-78cbcd5b-4019-4053-a78c-c9e6a9326d7e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.223153 May 18 22:47:59.736468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 319/644] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:47:59 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:47:59.856408 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:47:59.864995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3363ed79-c5db-40f5-a2a5-a2d725f86133 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.147011 May 18 22:47:59.865560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 326/645] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:47:59 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:00.733846 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:00.734429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:00.741013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:00.741455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:00.742236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:00.742663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:00.754371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:00.754998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:00.761090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:00.761532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:00.762330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:00.762743 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:00.934540 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:00.942498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-451ee308-2924-475a-ba4a-50036def7d95 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.212571 May 18 22:48:00.943067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 320/646] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:00 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:00.947699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:00.948228 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:00.950380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:00.954141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:00.954587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:00.955343 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:00.955774 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:00.959195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:00.960676 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:00.961803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a8e3df1-9c1f-46fa-afbb-278dd09a22da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.211865 May 18 22:48:00.962386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 327/647] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:00 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:48:01.086908 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:01.094716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2e095f21-7c1e-44a2-b7c9-309875a74ffb tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.150728 May 18 22:48:01.095290 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 321/648] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:00 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:01.960407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:01.961010 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:01.967072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:01.967510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:01.968255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:01.968682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:01.980419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:01.981045 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:01.987669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:01.988110 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:01.988864 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:01.989299 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:02.166474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:02.170373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:02.174379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c2c8d8dc-c593-4890-a88e-24d4e83e88da tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.218390 May 18 22:48:02.175165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 328/649] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:01 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:02.179188 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:02.179586 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:02.180186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:02.180683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:02.181803 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1d288dda-4506-4f9b-a094-17890bfb0513 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.205207 May 18 22:48:02.192962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 322/650] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:01 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:48:02.193116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:02.193116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:02.193116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:02.193116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:02.313371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:02.321815 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2413b0ca-f8ff-4f27-a489-0d67db92a030 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.145713 May 18 22:48:02.322416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 329/651] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:02 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:03.192441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:03.193054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:03.200045 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:03.200472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:03.200967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:03.201085 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:03.201298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:03.201691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:03.208147 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:03.208591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:03.209351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:03.209786 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:03.513692 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:03.522304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3c578918-337b-4d7d-ba9a-c9f2ccdb9756 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1681 microversion: 2.1 time: 0.334154 May 18 22:48:03.523154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 323/652] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:03 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:03.527792 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:03.528394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:03.534451 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:03.534938 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:03.535713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:03.536155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:03.538120 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:03.546967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:03.549056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:03.550974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9e966f39-b023-49b6-b0d4-5445b278502c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.354439 May 18 22:48:03.551963 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 330/653] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:03 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:03.684995 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:03.694727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fdcd1c53-3e38-44c6-ace3-3502ab879322 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1725 microversion: 2.1 time: 0.170594 May 18 22:48:03.695451 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 324/654] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:03 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:04.087360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-58143f46-ce66-41a1-a1f3-7cd567389671 req-3630709f-4816-4cd2-a42f-30a2d7383f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11859bc6-9f40-4ebd-a362-f02edc56387f", "name": "network-vif-deleted", "tag": "7dae3f3b-8bc8-4a34-8417-b95ba6b1c353"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:04.095917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-58143f46-ce66-41a1-a1f3-7cd567389671 req-3630709f-4816-4cd2-a42f-30a2d7383f71 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.097079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-58143f46-ce66-41a1-a1f3-7cd567389671 req-3630709f-4816-4cd2-a42f-30a2d7383f71 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.109825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-58143f46-ce66-41a1-a1f3-7cd567389671 req-3630709f-4816-4cd2-a42f-30a2d7383f71 service nova] Creating event network-vif-deleted:7dae3f3b-8bc8-4a34-8417-b95ba6b1c353 for instance 11859bc6-9f40-4ebd-a362-f02edc56387f on hv-cinder-83800 May 18 22:48:04.115649 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-58143f46-ce66-41a1-a1f3-7cd567389671 req-3630709f-4816-4cd2-a42f-30a2d7383f71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033416 May 18 22:48:04.116740 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 331/655] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:04.541227 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:04.541802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:04.548429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.549138 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.550847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.551282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.569687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:04.570423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:04.577014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.577726 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.578709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.579304 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.584431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.584877 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.585492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'fault' on Instance uuid 11859bc6-9f40-4ebd-a362-f02edc56387f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:48:04.632766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:04.641274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-50864fd6-2c0e-4966-9fdb-b620483e3cce tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1331 microversion: 2.1 time: 0.104049 May 18 22:48:04.642605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 325/656] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:04 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:04.714054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:04.714770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:04.722378 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.723353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.724480 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.725033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.733659 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:04.746873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:04.753583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:04.755175 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7b232f7f-20b2-4f90-99ff-aed8d37fac42 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.189801 May 18 22:48:04.765795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 332/657] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:04 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:04.873154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:04.882323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-081eafa1-054f-4042-b3ed-4992c51ce4e5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1731 microversion: 2.1 time: 0.172681 May 18 22:48:04.887198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 326/658] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:04 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:04.902703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:04.903280 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:04.910266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.910798 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.911633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:04.912244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:04.999410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3f084b11-0064-4ddb-842e-97d19f019786 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101036 May 18 22:48:05.000016 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 333/659] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:48:04 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:48:05.666353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:05.666960 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:05.674107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:05.675010 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:05.675948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:05.676584 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:05.710472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:05.710917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:05.711366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'fault' on Instance uuid 11859bc6-9f40-4ebd-a362-f02edc56387f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:48:05.774475 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:05.775330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:05.781695 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:05.782278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:05.783259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:05.783390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:05.789966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:05.798847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cd223c36-59b6-431f-88e8-dc294e705023 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1331 microversion: 2.1 time: 0.137343 May 18 22:48:05.799813 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 327/660] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:05 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:06.007007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:06.015608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:06.017100 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:06.018925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1eefbb65-d610-4046-8ae7-86fdd3835b0b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.247900 May 18 22:48:06.020164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 334/661] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:05 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:48:06.130356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-b1a904cd-2720-4745-b8d6-2565be17535c req-a4e26b62-bd58-4f87-9159-96074a7cdb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c0219f-b3e3-4a3c-98fa-247fb1d60b69", "tag": "be154673-4ae6-488f-9ecd-8923c95db8c4"}, {"name": "network-changed", "server_uuid": "d0c0219f-b3e3-4a3c-98fa-247fb1d60b69", "tag": "be154673-4ae6-488f-9ecd-8923c95db8c4"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:06.139826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-b1a904cd-2720-4745-b8d6-2565be17535c req-a4e26b62-bd58-4f87-9159-96074a7cdb44 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:06.140194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-b1a904cd-2720-4745-b8d6-2565be17535c req-a4e26b62-bd58-4f87-9159-96074a7cdb44 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:06.154568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-b1a904cd-2720-4745-b8d6-2565be17535c req-a4e26b62-bd58-4f87-9159-96074a7cdb44 service nova] Creating event network-changed:be154673-4ae6-488f-9ecd-8923c95db8c4 for instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 on hv-cinder-83800 May 18 22:48:06.155234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-b1a904cd-2720-4745-b8d6-2565be17535c req-a4e26b62-bd58-4f87-9159-96074a7cdb44 service nova] Creating event network-changed:be154673-4ae6-488f-9ecd-8923c95db8c4 for instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 on hv-cinder-83800 May 18 22:48:06.161296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-b1a904cd-2720-4745-b8d6-2565be17535c req-a4e26b62-bd58-4f87-9159-96074a7cdb44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035442 May 18 22:48:06.162321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 328/662] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:06.816674 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:06.817290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:06.824037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:06.828849 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:06.828849 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:06.828849 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:06.864238 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:06.864389 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:06.864849 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'fault' on Instance uuid 11859bc6-9f40-4ebd-a362-f02edc56387f {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:48:06.936709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:06.944557 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-987295e9-8fe4-4123-a41d-cca2471a9193 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 200 len: 1331 microversion: 2.1 time: 0.132641 May 18 22:48:06.945381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 335/663] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:06 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:07.038917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:07.039612 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:07.051101 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:07.052065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:07.053340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:07.054053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:07.485583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:07.494519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:07.496000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:07.497149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e880df99-fc96-47d3-915d-70feba454e5e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.463209 May 18 22:48:07.497707 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 329/664] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:07 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:07.962574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:07.963180 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:07.969125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:07.969572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:07.970362 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:07.970791 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:07.985100 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f HTTP/1.1 May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:48:07.987135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:48:07.991320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '11859bc6-9f40-4ebd-a362-f02edc56387f'} May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:48:07.992095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:48:07.993320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:48:07.994472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:48:07.994472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-596c6cab-27ee-4b3f-a741-30eed05f4bd1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 404 len: 111 microversion: 2.1 time: 0.030214 May 18 22:48:07.994472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 336/665] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:07 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:48:07.997260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a80215a1-856e-43cb-91ba-f2c01156e007 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '.version_select at 0x7f6cd8ece4c0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:08.090376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a80215a1-856e-43cb-91ba-f2c01156e007 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310297856" status: 202 len: 0 microversion: 2.1 time: 0.096711 May 18 22:48:08.091057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 330/666] 10.222.0.70 () {58 vars in 1217 bytes} [Wed May 18 22:48:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310297856 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:48:08.514785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:08.515468 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:08.522191 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:08.522655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:08.523485 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:08.523923 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:08.722814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:08.731299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:08.732891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:08.734056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a38a4de8-3738-4b03-ac6b-609f8709dc74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.223266 May 18 22:48:08.734621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 337/667] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:08 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:08.942936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:08.943429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:08.949397 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:08.949841 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:08.950765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:08.951199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:09.031078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'services' on Instance uuid 097a1c9f-e116-4327-a473-ab82fe379d7f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:48:09.066775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:09.293554 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d1b0c4e5-ba35-45fa-b663-a9e3a31264ef tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments/9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe" status: 202 len: 0 microversion: 2.1 time: 0.355258 May 18 22:48:09.294349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 331/668] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:48:08 2022] DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments/9ab2a1c9-aca9-422b-8de8-b8c9ea2a1cfe => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:48:09.303843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:09.304802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:09.310829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:09.311203 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:09.311958 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:09.312390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:09.342359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-837123d7-d30b-4c7a-9657-5206f525d2c0 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 May 18 22:48:09.342919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 338/669] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:48:09 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:09.753471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:09.754273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:09.760472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:09.760921 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:09.761681 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:09.762172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:09.897021 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:09.905615 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:09.909596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:09.909596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-06f23376-1a00-41e9-821b-cdd24fcd0d37 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.159714 May 18 22:48:09.909817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 332/670] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:09 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:10.354163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:10.355102 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:10.361091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:10.361501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:10.362283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:10.362883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:10.379958 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:10.392736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6e677f9e-f3f9-46e8-9f6f-63b3f39a115f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042489 May 18 22:48:10.397300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 339/671] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:48:10 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:10.505151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-39c26248-a9b6-462b-a8a8-09a7a56507c5 req-a951894d-270e-4eed-ae62-7eaf877eb4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "name": "network-vif-plugged", "status": "completed", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:10.513926 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-39c26248-a9b6-462b-a8a8-09a7a56507c5 req-a951894d-270e-4eed-ae62-7eaf877eb4e2 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:10.514388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-39c26248-a9b6-462b-a8a8-09a7a56507c5 req-a951894d-270e-4eed-ae62-7eaf877eb4e2 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:10.525663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-39c26248-a9b6-462b-a8a8-09a7a56507c5 req-a951894d-270e-4eed-ae62-7eaf877eb4e2 service nova] Creating event network-vif-plugged:96fba53d-5676-4c31-9cb9-19ddb31ada27 for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 on hv-cinder-83800 May 18 22:48:10.530531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-39c26248-a9b6-462b-a8a8-09a7a56507c5 req-a951894d-270e-4eed-ae62-7eaf877eb4e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029624 May 18 22:48:10.531111 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 333/672] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:10.927954 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:10.928475 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:10.934829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:10.935270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:10.936021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:10.936446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.068193 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:11.076512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:11.077995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:11.079162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1a63d0c6-735e-476a-8faa-7bc3f7dea7cf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.155607 May 18 22:48:11.079910 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 340/673] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:10 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:11.405601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:11.406634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:11.413201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:11.413650 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.414519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:11.414951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.445680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ec370a83-de77-48dc-a9ab-836148855b7d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044374 May 18 22:48:11.446276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 334/674] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:48:11 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:48:11.503781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:11.504290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:11.510392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:11.510845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.511643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:11.512080 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.537368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:48:11.803330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9b81b8e6-1c5d-47ce-9a12-99a23bead238 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 204 len: 0 microversion: 2.1 time: 0.303594 May 18 22:48:11.803846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 341/675] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:48:11 2022] DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:48:11.811907 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:11.812621 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:11.819533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:11.819986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.820768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:11.821709 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:11.950279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:11.957696 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-28d27122-2267-49e9-9053-4b6ca5a99646 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1682 microversion: 2.1 time: 0.149540 May 18 22:48:11.958287 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 335/676] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:11 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:12.099370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:12.100059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:12.106220 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:12.106672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:12.107430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:12.107863 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:12.239121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:12.247568 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:12.249071 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:12.250243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aad572d9-e819-4db5-9698-b62d21f21a47 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.155859 May 18 22:48:12.250800 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 342/677] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:12 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:12.977280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:12.977891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:12.985947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:12.986414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:12.987184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:12.987608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:13.132272 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:13.139607 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd25bfe6-5557-49a7-b8ec-9ca95c22bf98 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1682 microversion: 2.1 time: 0.168453 May 18 22:48:13.140165 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 336/678] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:12 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:48:13.268906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:13.269573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:13.275696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:13.276147 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:13.276912 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:13.277351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:13.410023 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:13.418433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:13.419926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:13.421068 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9491e580-1aa0-492f-abe3-e3f9d3d2517c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1809 microversion: 2.20 time: 0.156736 May 18 22:48:13.421628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 343/679] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:13 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:14.157975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:14.159150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:14.165723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:14.166312 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:14.167162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:14.167609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:14.382718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:14.390449 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-11af8ca6-5043-4251-9938-4c26ce7c0593 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1682 microversion: 2.1 time: 0.236339 May 18 22:48:14.391090 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 337/680] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:14 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:14.440046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:14.440885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:14.447022 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:14.452750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:14.452750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:14.452750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:14.688868 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:14.697335 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:14.698848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:14.699989 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd4a185a-270b-455d-a0e4-a39436f621b6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1796 microversion: 2.20 time: 0.264077 May 18 22:48:14.700546 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 344/681] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:48:14 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1796 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:48:14.857677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-fd445ce4-29d7-423b-bf24-100354e5a4b3 req-6e79cc02-04a4-445b-b428-b709765cd591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "097a1c9f-e116-4327-a473-ab82fe379d7f", "name": "network-vif-deleted", "tag": "d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:14.865632 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-fd445ce4-29d7-423b-bf24-100354e5a4b3 req-6e79cc02-04a4-445b-b428-b709765cd591 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:14.869233 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-fd445ce4-29d7-423b-bf24-100354e5a4b3 req-6e79cc02-04a4-445b-b428-b709765cd591 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:14.877245 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-fd445ce4-29d7-423b-bf24-100354e5a4b3 req-6e79cc02-04a4-445b-b428-b709765cd591 service nova] Creating event network-vif-deleted:d2906a1e-0e35-4157-9c0a-1a0a6fa95ba7 for instance 097a1c9f-e116-4327-a473-ab82fe379d7f on hv-cinder-83800 May 18 22:48:14.883819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-fd445ce4-29d7-423b-bf24-100354e5a4b3 req-6e79cc02-04a4-445b-b428-b709765cd591 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029752 May 18 22:48:14.884507 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 338/682] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:15.408620 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:15.409406 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:15.415390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:15.415839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:15.416593 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:15.417023 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:15.454330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:15.454330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:15.454330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'fault' on Instance uuid 097a1c9f-e116-4327-a473-ab82fe379d7f {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:48:15.493429 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:15.500825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f1b0eaeb-8cc5-47f7-a69f-ab3e634621cb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 200 len: 1332 microversion: 2.1 time: 0.096048 May 18 22:48:15.501392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 345/683] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:15 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:16.519990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:16.520690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:16.526859 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:16.527301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:16.528054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:16.528483 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:16.541581 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f HTTP/1.1 May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:48:16.543170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:48:16.544794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '097a1c9f-e116-4327-a473-ab82fe379d7f'} May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:48:16.545588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:48:16.546812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:48:16.548035 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:48:16.548035 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d6e7e0d2-0cf5-44c0-82a1-f9a571df6700 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 404 len: 111 microversion: 2.1 time: 0.030289 May 18 22:48:16.548035 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 339/684] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:16 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:48:16.553555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fe642160-23b5-48c0-9397-aa6ba6d5a4a7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '.version_select at 0x7f6cde153550>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:16.631754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fe642160-23b5-48c0-9397-aa6ba6d5a4a7 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354280919" status: 202 len: 0 microversion: 2.1 time: 0.081915 May 18 22:48:16.632330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 346/685] 10.222.0.70 () {58 vars in 1220 bytes} [Wed May 18 22:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354280919 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:48:17.593358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2c3557d4-8e50-4d26-a485-35a647439d84 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: .version_select at 0x7f6cd8f10820>, body: {"keypair": {"name": "tempest-keypair-1631777844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBertUmVon2Npmq1Ci3u5uabnfi5BO5+zFrOEYIbuSvB9eJ3jkk7APflKqrXJ4fqAuvO8GLMcXc123zFuBVc4ig6M+xd1c2ljC6iUznzaN6LadHO4xlopplRvX2IeaVbQ=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:17.607768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-2c3557d4-8e50-4d26-a485-35a647439d84 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:48:17.611488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-2c3557d4-8e50-4d26-a485-35a647439d84 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:48:17.690625 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2c3557d4-8e50-4d26-a485-35a647439d84 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100389 May 18 22:48:17.691271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 340/686] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:48:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:19.881932 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-113538222", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbd3cb94-6b06-443d-a376-6f705f586753"}], "security_groups": [{"name": "tempest-securitygroup--808316095"}], "key_name": "tempest-keypair-1631777844", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:19.982805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] validate_networks() for [('fbd3cb94-6b06-443d-a376-6f705f586753', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:48:20.571453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:48:20.571877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:48:20.572348 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:48:20.572754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:48:20.573162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:48:20.582660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:20.583109 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:20.583931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:20.584366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:20.601085 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:48:20.605012 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:48:20.616331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:48:20.618600 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:48:20.742745 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b482ecb8-66da-4b54-8065-7269ed9f310c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.865150 May 18 22:48:20.743313 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 347/687] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:48:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:48:20.754276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6afd315d-c7a9-498d-a77a-d9ed1aa2d531 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:20.754890 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6afd315d-c7a9-498d-a77a-d9ed1aa2d531 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:20.810258 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6afd315d-c7a9-498d-a77a-d9ed1aa2d531 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:20.817046 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6afd315d-c7a9-498d-a77a-d9ed1aa2d531 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1241 microversion: 2.1 time: 0.067529 May 18 22:48:20.817608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 341/688] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:20 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:48:21.834950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:21.835591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:21.837594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:21.842552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:21.848326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:21.848326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:21.848326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:21.912096 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:21.919452 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6b47a3f3-2ba8-4242-8e0e-7172f46c1364 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1245 microversion: 2.1 time: 0.089073 May 18 22:48:21.920000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 348/689] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:21 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:22.936841 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:22.937454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:22.944390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:22.944844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:22.945620 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:22.946301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:23.021076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:23.028492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d988de0d-25f6-4c59-823e-78bfc4e5d748 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1311 microversion: 2.1 time: 0.095711 May 18 22:48:23.029203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 342/690] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:22 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:24.052257 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:24.052903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:24.064160 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:24.065291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:24.072845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:24.072845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:24.278097 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:24.286511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-55ef7570-1b8f-4d34-968a-bf885ecbfbea tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.239319 May 18 22:48:24.287193 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 349/691] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:24 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:24.559025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-0ef14dac-d92a-407c-ba6b-bee8360440f7 req-6ffb2eae-e11f-4b61-ae06-f907ea09cbfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4", "tag": "97bbf516-76d1-4de0-b9b6-cb94305e0a32"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:24.565699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:24.571934 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0ef14dac-d92a-407c-ba6b-bee8360440f7 req-6ffb2eae-e11f-4b61-ae06-f907ea09cbfb service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:24.572381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0ef14dac-d92a-407c-ba6b-bee8360440f7 req-6ffb2eae-e11f-4b61-ae06-f907ea09cbfb service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:24.592737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-0ef14dac-d92a-407c-ba6b-bee8360440f7 req-6ffb2eae-e11f-4b61-ae06-f907ea09cbfb service nova] Creating event network-changed:97bbf516-76d1-4de0-b9b6-cb94305e0a32 for instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 on hv-cinder-83800 May 18 22:48:24.599060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-0ef14dac-d92a-407c-ba6b-bee8360440f7 req-6ffb2eae-e11f-4b61-ae06-f907ea09cbfb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043706 May 18 22:48:24.599875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 343/692] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:25.304621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:25.305217 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:25.311333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:25.311816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:25.312571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:25.313002 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:25.445732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:25.453087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b8784415-f05d-4a96-ab17-c89e5436278e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.152821 May 18 22:48:25.453708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 350/693] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:25 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:26.471478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:26.472840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:26.479747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:26.486590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:26.486590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:26.486590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:26.610078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:26.617994 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a6d94f26-f776-441d-a8e9-5c470e732847 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.151061 May 18 22:48:26.618585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 344/694] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:26 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:27.635133 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:27.635718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:27.641838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:27.642312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:27.643066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:27.643497 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:27.770539 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:27.777915 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-483d9308-729b-4cdc-a093-57d080716f53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.146629 May 18 22:48:27.778559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 351/695] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:27 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:28.795479 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:28.796083 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:28.803492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:28.803933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:28.804687 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:28.805117 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:28.937350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:28.945528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6469a19f-1f21-4a0a-a26e-36c0ba242170 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.153811 May 18 22:48:28.946295 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 345/696] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:28 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:29.962793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:29.963402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:29.969523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:29.969975 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:29.970758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:29.971190 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:30.101267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:30.108740 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5e52d123-e19d-4ef7-bfe2-69833d17da8c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.149760 May 18 22:48:30.109239 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 352/697] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:29 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:30.710395 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-b9cc53e5-d37a-4e07-860a-d94f17023f9d req-f7d81265-7c2a-457d-9588-08d14f8b2f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4", "name": "network-vif-plugged", "status": "completed", "tag": "97bbf516-76d1-4de0-b9b6-cb94305e0a32"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:30.718568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-b9cc53e5-d37a-4e07-860a-d94f17023f9d req-f7d81265-7c2a-457d-9588-08d14f8b2f74 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:30.718989 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-b9cc53e5-d37a-4e07-860a-d94f17023f9d req-f7d81265-7c2a-457d-9588-08d14f8b2f74 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:30.730171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-b9cc53e5-d37a-4e07-860a-d94f17023f9d req-f7d81265-7c2a-457d-9588-08d14f8b2f74 service nova] Creating event network-vif-plugged:97bbf516-76d1-4de0-b9b6-cb94305e0a32 for instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 on hv-cinder-83800 May 18 22:48:30.735203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-b9cc53e5-d37a-4e07-860a-d94f17023f9d req-f7d81265-7c2a-457d-9588-08d14f8b2f74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029046 May 18 22:48:30.735874 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 346/698] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:31.125943 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:31.126624 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:31.129057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:31.129903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:31.134806 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:31.135256 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:31.139136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:31.139136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:31.268395 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:31.275832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7ac75d02-b812-455a-8e3d-2dae4f9f1cf8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.153826 May 18 22:48:31.276396 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 353/699] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:31 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:32.290231 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:32.294806 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:32.297866 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:32.302486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:32.302931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:32.303689 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:32.304123 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:32.430648 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:32.438112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-77731091-0481-45e3-8def-e3371c6c58fa tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1366 microversion: 2.1 time: 0.148897 May 18 22:48:32.438686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 347/700] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:32 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:33.457042 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:33.458106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:33.464253 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:33.464714 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:33.465474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:33.465910 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:33.672142 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:33.680757 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-84bf930e-1daf-47e7-87ab-b59cef3862db tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1555 microversion: 2.1 time: 0.229042 May 18 22:48:33.681264 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 354/701] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:33 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:48:33.697636 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:33.698193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:33.704951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:33.705591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:33.706903 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:33.707648 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:33.818659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3f961ba4-2d13-4857-9a0b-a4088fff0f22 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124672 May 18 22:48:33.819224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 348/702] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:48:33 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:34.841683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-521a96c9-9e83-4dff-952b-ea1dfe3cffb6 req-547aff74-ac4f-48ef-afad-24e59af20e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4", "tag": "97bbf516-76d1-4de0-b9b6-cb94305e0a32"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:48:34.850683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-521a96c9-9e83-4dff-952b-ea1dfe3cffb6 req-547aff74-ac4f-48ef-afad-24e59af20e3f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:34.851118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-521a96c9-9e83-4dff-952b-ea1dfe3cffb6 req-547aff74-ac4f-48ef-afad-24e59af20e3f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:34.862060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-521a96c9-9e83-4dff-952b-ea1dfe3cffb6 req-547aff74-ac4f-48ef-afad-24e59af20e3f service nova] Creating event network-changed:97bbf516-76d1-4de0-b9b6-cb94305e0a32 for instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 on hv-cinder-83800 May 18 22:48:34.868214 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-521a96c9-9e83-4dff-952b-ea1dfe3cffb6 req-547aff74-ac4f-48ef-afad-24e59af20e3f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088871 May 18 22:48:34.868819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 355/703] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:48:58.327168 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=11 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:58.327849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:58.331639 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:58.332130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:58.338684 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:58.339133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:58.339895 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:58.340328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:58.365671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:48:58.669707 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e3838ac0-a912-410b-939e-0cf31a736159 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 204 len: 0 microversion: 2.1 time: 0.343747 May 18 22:48:58.670353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 349/704] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:48:58 2022] DELETE /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:48:58.676453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=15 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:58.677200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:48:58.681694 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:58.682426 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:58.688474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:58.688925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:58.689687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:58.690153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:58.824089 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:58.831490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0fbe545c-a638-4ef2-b546-2c86b5e44cd8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1576 microversion: 2.1 time: 0.156280 May 18 22:48:58.832066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 356/705] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:58 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:48:59.850065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:48:59.850756 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:48:59.857414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:59.857854 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:59.858638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:48:59.859067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:48:59.987109 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:48:59.994792 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0ae6ef55-5cc7-446d-bd0b-f7e13293901b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1576 microversion: 2.1 time: 0.149100 May 18 22:48:59.995358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 350/706] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:48:59 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:01.013191 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:01.013808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:01.020605 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:01.021059 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:01.021824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:01.022288 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:01.236380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:01.244312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3385ade2-2ff2-4ad7-8cdc-434eea7da17a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1576 microversion: 2.1 time: 0.235000 May 18 22:49:01.244869 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 357/707] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:01 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:01.968144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-bf6ae41b-628e-41ed-83ea-df8114dc360e req-be1d5592-59b9-4af9-8d15-e90676ecd0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f60a91a-04f2-4c00-9a6a-fa540a8b57ea", "name": "network-vif-deleted", "tag": "44c157c3-379b-4597-8ca7-33a80833c6e1"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:01.980683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-bf6ae41b-628e-41ed-83ea-df8114dc360e req-be1d5592-59b9-4af9-8d15-e90676ecd0df service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:01.984670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-bf6ae41b-628e-41ed-83ea-df8114dc360e req-be1d5592-59b9-4af9-8d15-e90676ecd0df service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:01.992490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-bf6ae41b-628e-41ed-83ea-df8114dc360e req-be1d5592-59b9-4af9-8d15-e90676ecd0df service nova] Creating event network-vif-deleted:44c157c3-379b-4597-8ca7-33a80833c6e1 for instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea on hv-cinder-83800 May 18 22:49:01.997599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-bf6ae41b-628e-41ed-83ea-df8114dc360e req-be1d5592-59b9-4af9-8d15-e90676ecd0df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033389 May 18 22:49:01.998338 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 351/708] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:02.261331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:02.262030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:02.268389 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:02.268936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:02.269775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:02.270247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:02.334535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:02.343162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8e106d7c-824e-4013-988c-c1344def326c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1225 microversion: 2.1 time: 0.086319 May 18 22:49:02.350653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 358/709] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:02 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:03.360426 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:03.361017 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:03.367829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:03.368274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:03.369031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:03.369457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:03.401810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:03.402281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:03.402717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lazy-loading 'fault' on Instance uuid 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:03.444182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:03.451766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-da45ac81-5881-4ecf-9a54-7a5ebb5ba9d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 200 len: 1230 microversion: 2.1 time: 0.095988 May 18 22:49:03.452322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 352/710] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:03 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:04.468560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:04.469170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:04.475223 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:04.475672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:04.477055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:04.477489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:04.490500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] HTTP exception thrown: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Request method failure captured: May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea HTTP/1.1 May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXbtWlYObrEmgMa-rUUTaZtbjyCf3XR3deXQts_dU9IznpZ4SI3d-oG3TZNEeTcJ5-UyoO55UK6m3e-cP4-AtWl41A-ROpj6szbQ7unzFVdUuIz1tWt98e0f795Y-JV1A21zbWZpE2UaAnzYo91xsZ9IsouqWwFbiBmB19kWWq9liBU May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:49:04.492117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7994cefc64b44d1e92e94a9c8c1cca31", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7994cefc64b44d1e92e94a9c8c1cca31"}]}] May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestVolumeBootPattern-1940142891 May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-TestVolumeBootPattern-1940142891-project May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 298370ea294c4150be7de29116e49d73 May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestVolumeBootPattern-1940142891-project May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:49:04.493646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '6f60a91a-04f2-4c00-9a6a-fa540a8b57ea'} May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:49:04.494578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:49:04.495909 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:04.497031 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Returning 404 to user: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:49:04.497031 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-28937ba7-abed-45bd-91d5-e972047262d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 404 len: 111 microversion: 2.1 time: 0.028853 May 18 22:49:04.497031 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 359/711] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:04 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:49:04.587176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-414778112", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923270520", "security_groups": [{"name": "tempest-secgroup-smoke-552150152"}], "block_device_mapping_v2": [{"uuid": "ac2fc6e9-6334-4fb3-90b8-cc6d02f9c47f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb762368-0a84-43af-8013-3ba314096c24"}]}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:04.697103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] validate_networks() for [('cb762368-0a84-43af-8013-3ba314096c24', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:49:05.059127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:49:05.059542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:49:05.060039 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:49:05.060437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:49:05.061368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:49:05.070283 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:05.070749 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:05.071531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:05.071959 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:05.088333 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:49:05.092167 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for user 298370ea294c4150be7de29116e49d73 and project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:49:05.149270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:49:05.151399 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac2fc6e9-6334-4fb3-90b8-cc6d02f9c47f',volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:49:05.603600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9008308e-3d7f-4291-951f-90ce8953738b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020939 May 18 22:49:05.604411 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 353/712] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:49:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:49:05.614281 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f5db85fd-d18a-46b7-ad7d-aa32b5fcdeb8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:05.614888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f5db85fd-d18a-46b7-ad7d-aa32b5fcdeb8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:05.670523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f5db85fd-d18a-46b7-ad7d-aa32b5fcdeb8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:05.678266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f5db85fd-d18a-46b7-ad7d-aa32b5fcdeb8 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1093 microversion: 2.1 time: 0.067971 May 18 22:49:05.678817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 360/713] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:05 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:06.695993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:06.696605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:06.703408 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:06.703857 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:06.704688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:06.705128 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:06.770688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:06.778994 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d87b8359-8836-418a-b432-2f47f235c8fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1135 microversion: 2.1 time: 0.087516 May 18 22:49:06.779558 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 354/714] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:06 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1135 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:07.795921 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:07.796527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:07.803165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:07.803614 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:07.804684 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:07.805152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:07.896575 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:07.904863 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cd976504-2cda-4b75-9b3e-2808b5f1ebf1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1209 microversion: 2.1 time: 0.112943 May 18 22:49:07.905431 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 361/715] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:07 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:08.923450 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:08.924076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:08.931010 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:08.931444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:08.932409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:08.932888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:09.132249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:09.139784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-160329c9-ed14-46cd-b9b7-75065bc85dd4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1276 microversion: 2.1 time: 0.220489 May 18 22:49:09.140462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 355/716] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:08 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:09.277602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-3cd3149e-f5c1-4484-9d7e-214bf641eedf req-ff121bd7-11c0-4a11-8139-84ff83333e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d633259-1327-45ac-bc36-0db6e2a3ac0d", "tag": "2170f6d7-e113-4873-9f11-d973d6171ab9"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:09.286955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3cd3149e-f5c1-4484-9d7e-214bf641eedf req-ff121bd7-11c0-4a11-8139-84ff83333e80 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:09.287894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3cd3149e-f5c1-4484-9d7e-214bf641eedf req-ff121bd7-11c0-4a11-8139-84ff83333e80 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:09.305829 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-3cd3149e-f5c1-4484-9d7e-214bf641eedf req-ff121bd7-11c0-4a11-8139-84ff83333e80 service nova] Creating event network-changed:2170f6d7-e113-4873-9f11-d973d6171ab9 for instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d on hv-cinder-83800 May 18 22:49:09.310824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-3cd3149e-f5c1-4484-9d7e-214bf641eedf req-ff121bd7-11c0-4a11-8139-84ff83333e80 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037513 May 18 22:49:09.311428 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 362/717] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:09.409780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:09.410586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:09.421349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:09.421791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:09.422874 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:09.423413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:09.504856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'services' on Instance uuid d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:09.750032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-87b8129d-3d38-4df5-af75-44e0b7797c0b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments/900a1455-5a49-451d-b0db-2cff99499a2d" status: 202 len: 0 microversion: 2.1 time: 0.343981 May 18 22:49:09.750663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 356/718] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:49:09 2022] DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments/900a1455-5a49-451d-b0db-2cff99499a2d => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:49:09.760148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:09.761297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:09.768097 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:09.768556 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:09.769332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:09.769770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:09.801460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fb624d1c-189e-46a4-85e7-c9235717e11c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 May 18 22:49:09.802086 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 363/719] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:49:09 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:10.156879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:10.157602 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:10.163933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:10.164376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:10.165126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:10.165554 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:10.309635 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:10.317182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ce46ac30-050f-4450-9971-44c0a9eebd50 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.164888 May 18 22:49:10.317697 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 357/720] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:10 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:10.813758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:10.814710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:10.820832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:10.821283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:10.822221 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:10.822664 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:10.851590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-022fd6a9-2106-47d0-beca-7df198286293 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041268 May 18 22:49:10.852145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 364/721] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:49:10 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:11.335768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:11.336354 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:11.342832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:11.343282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:11.344054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:11.344998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:11.480441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:11.488112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8bd92de7-86aa-41dc-8ab9-9baf162ddd7c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.156722 May 18 22:49:11.488678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 358/722] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:11 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:11.864216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:11.865057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:11.871364 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:11.871811 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:11.872576 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:11.873014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:11.901911 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-366fea9e-f841-4004-a9b9-b90bad145159 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041718 May 18 22:49:11.902511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 365/723] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:49:11 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:49:11.978662 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:11.979161 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:11.985348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:11.985790 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:11.986589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:11.987022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:12.013192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:49:12.247819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-67f4ba33-55be-48f9-998d-ea9a43db9d5a tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 204 len: 0 microversion: 2.1 time: 0.273430 May 18 22:49:12.248405 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 359/724] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:49:11 2022] DELETE /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:49:12.256440 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:12.260282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:12.264138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:12.264582 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:12.265339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:12.265787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:12.392361 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:12.400762 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f17c0e61-474f-488d-82c3-f5ef62e3c16e tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1691 microversion: 2.1 time: 0.148150 May 18 22:49:12.401315 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 366/725] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:12 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:12.505493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:12.506172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:12.513089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:12.513535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:12.514318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:12.514754 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:12.648962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:12.656490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-89f2972e-9cbd-4840-af51-c0c0db5558d3 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.155227 May 18 22:49:12.657068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 360/726] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:12 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:13.417857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:13.418537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:13.424904 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:13.427251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:13.427251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:13.427251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:13.577511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:13.584894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-29374a35-a6d8-4b30-b150-3070f2812c9b tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1691 microversion: 2.1 time: 0.170898 May 18 22:49:13.585513 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 367/727] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:13 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:13.674386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:13.674947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:13.682493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:13.683880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:13.683880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:13.684186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:13.816388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:13.823894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-11c7106e-2c0b-41a4-a91b-62bd62ef5d9a tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.153847 May 18 22:49:13.824461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 361/728] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:13 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:14.601516 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:14.602145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:14.608063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:14.608504 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:14.609251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:14.609682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:14.734937 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:14.742767 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ff4f1cb0-2bc5-4797-a9d9-6e89d7474541 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1691 microversion: 2.1 time: 0.145029 May 18 22:49:14.743324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 368/729] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:14 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1691 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:14.840715 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:14.841326 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:14.847802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:14.848252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:14.849011 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:14.849443 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:14.868485 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:14.980166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:14.987578 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5247ba82-19a5-40ec-81de-3cfe815d9753 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.150567 May 18 22:49:14.988088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 362/730] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:14 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:15.759776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:15.760377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:15.762393 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:15.767173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:15.767616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:15.768376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:15.768810 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:15.899668 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:15.907040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-11ecc3e4-c71b-4f50-99b9-6e671495821d tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1691 microversion: 2.1 time: 0.151139 May 18 22:49:15.907606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 369/731] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:15 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:16.004612 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:16.005160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:16.007061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:16.007733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:16.012981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:16.013429 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:16.014322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:16.014765 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:16.209773 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:16.217262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d0333412-be9e-4ac0-978d-458f03b976a6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.216549 May 18 22:49:16.218071 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 363/732] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:15 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:16.924082 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:16.924713 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:16.931934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:16.932380 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:16.933156 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:16.933587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:16.991993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-f1588e24-01f1-4adb-82c1-d66d22a7df32 req-d9123235-f8ae-465d-bdff-c2fe1004fb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c0219f-b3e3-4a3c-98fa-247fb1d60b69", "name": "network-vif-deleted", "tag": "be154673-4ae6-488f-9ecd-8923c95db8c4"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:17.000444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-f1588e24-01f1-4adb-82c1-d66d22a7df32 req-d9123235-f8ae-465d-bdff-c2fe1004fb77 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:17.000710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-f1588e24-01f1-4adb-82c1-d66d22a7df32 req-d9123235-f8ae-465d-bdff-c2fe1004fb77 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:17.012801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:17.013266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-f1588e24-01f1-4adb-82c1-d66d22a7df32 req-d9123235-f8ae-465d-bdff-c2fe1004fb77 service nova] Creating event network-vif-deleted:be154673-4ae6-488f-9ecd-8923c95db8c4 for instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 on hv-cinder-83800 May 18 22:49:17.018206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-f1588e24-01f1-4adb-82c1-d66d22a7df32 req-d9123235-f8ae-465d-bdff-c2fe1004fb77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030417 May 18 22:49:17.019019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 364/733] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:49:17.020621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-67b8d091-12d6-4e27-8dc0-8e2adedc4fd1 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1623 microversion: 2.1 time: 0.100490 May 18 22:49:17.031929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 370/734] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:16 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1623 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:17.234415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:17.235159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:17.241909 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:17.242666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:17.243447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:17.243885 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:17.379849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:17.387337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-16309938-cbf0-4610-ba5c-b877361eb194 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.157088 May 18 22:49:17.387991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 365/735] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:17 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:18.036549 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:18.037166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:18.043367 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:18.043808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:18.044594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:18.045025 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:18.076093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:18.076540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:18.076982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'fault' on Instance uuid d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:18.362386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:18.370594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cc9f6263-61b8-4e64-9b0c-de9996c6d5f9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 200 len: 1336 microversion: 2.1 time: 0.337881 May 18 22:49:18.371178 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 371/736] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:18 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 1336 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:18.404427 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:18.405029 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:18.411424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:18.411862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:18.412614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:18.413742 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:18.545718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:18.554158 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8e9bef19-fd14-46e7-b484-0da1843c18f2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.153000 May 18 22:49:18.558058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 366/737] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:18 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:49:19.387499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:19.393087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: d0c0219f-b3e3-4a3c-98fa-247fb1d60b69] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:19.394190 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:19.394638 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:19.395422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:19.395850 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:19.409490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] HTTP exception thrown: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 could not be found. May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Request method failure captured: May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 HTTP/1.1 May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYbjbQ_ZECXKziv0DZA2jsqDVXSP0EvU9dofmfutAYSWvDZ81U29vslocOQviFQ316tWoKBt7Od5qL1GEX7Hynj86iWvdoINgd-2xRnIap59pJ9KS4mUSM4YamWixkWBcVmES0W5IxsL_ag2L4ho9fS-O55lcqVreepKfvdP0j2q0s May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:49:19.411130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c184ebb6e93a4cd58d65d8fbe43c4760", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c184ebb6e93a4cd58d65d8fbe43c4760"}]}] May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: be51e8b84bb7471bb17409b331e599eb May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 could not be found. May 18 22:49:19.412753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'd0c0219f-b3e3-4a3c-98fa-247fb1d60b69'} May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 could not be found. May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:49:19.413677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 could not be found. May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 could not be found. May 18 22:49:19.415047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:49:19.416437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Returning 404 to user: Instance d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:49:19.416437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c88a282b-ac65-420b-9379-018dc72711d0 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69" status: 404 len: 111 microversion: 2.1 time: 0.028860 May 18 22:49:19.416437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 372/738] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:19 2022] GET /compute/v2.1/servers/d0c0219f-b3e3-4a3c-98fa-247fb1d60b69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:49:19.421642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1ba71c83-cdc4-4756-86b2-4835e125a911 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '.version_select at 0x7f6cd8e4c4c0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:19.511004 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1ba71c83-cdc4-4756-86b2-4835e125a911 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124707447" status: 202 len: 0 microversion: 2.1 time: 0.092987 May 18 22:49:19.511607 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 367/739] 10.222.0.70 () {58 vars in 1220 bytes} [Wed May 18 22:49:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124707447 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:49:19.572561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:19.573360 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:19.579926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:19.580576 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:19.581486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:19.582257 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:19.722922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:19.731535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-572e6f2b-0e7f-48b9-b2d1-1ef42cb2132c tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.164010 May 18 22:49:19.732166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 373/740] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:19 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:20.748888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:20.749494 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:20.755470 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:20.755917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:20.756670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:20.757896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:20.891656 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:20.899589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d6b64fae-17f2-44b0-9f3e-3942e33fc502 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.154964 May 18 22:49:20.900168 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 368/741] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:20 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:20.964131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-1e763f72-b9cd-43ee-b730-ae8e0fca32e7 req-0eaabb47-ea6d-4543-8426-3892460fb877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d633259-1327-45ac-bc36-0db6e2a3ac0d", "name": "network-vif-plugged", "status": "completed", "tag": "2170f6d7-e113-4873-9f11-d973d6171ab9"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:20.972381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1e763f72-b9cd-43ee-b730-ae8e0fca32e7 req-0eaabb47-ea6d-4543-8426-3892460fb877 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:20.972815 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-1e763f72-b9cd-43ee-b730-ae8e0fca32e7 req-0eaabb47-ea6d-4543-8426-3892460fb877 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:20.985628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-1e763f72-b9cd-43ee-b730-ae8e0fca32e7 req-0eaabb47-ea6d-4543-8426-3892460fb877 service nova] Creating event network-vif-plugged:2170f6d7-e113-4873-9f11-d973d6171ab9 for instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d on hv-cinder-83800 May 18 22:49:20.990944 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-1e763f72-b9cd-43ee-b730-ae8e0fca32e7 req-0eaabb47-ea6d-4543-8426-3892460fb877 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030335 May 18 22:49:20.992158 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 374/742] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:21.916667 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:21.917310 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:21.924766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:21.925213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:21.925979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:21.926498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.063622 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:22.071059 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6940d206-9a3a-4468-9a89-7ea16f676775 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.158195 May 18 22:49:22.071636 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 369/743] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:21 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:22.105625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:22.106243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:22.113297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.113785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.114746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.116148 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.144089 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=100 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:22.148378 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-66a902df-dccd-4ec6-8305-f539cbc849ac tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments/027b8bbc-39f6-4907-bf76-911ac3300ad5" status: 200 len: 194 microversion: 2.20 time: 0.155449 May 18 22:49:22.148955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 375/744] 10.222.0.70 () {60 vars in 1453 bytes} [Wed May 18 22:49:21 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments/027b8bbc-39f6-4907-bf76-911ac3300ad5 => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:49:22.211980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:22.212529 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:22.219068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.219515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.220276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.220709 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.298736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lazy-loading 'services' on Instance uuid 8e35b912-5d2e-451c-b856-af4bb422a6c0 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:22.464130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c68323c5-091a-42e7-b46c-0ba47dca8d96 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments/027b8bbc-39f6-4907-bf76-911ac3300ad5" status: 202 len: 0 microversion: 2.20 time: 0.255958 May 18 22:49:22.464836 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 370/745] 10.222.0.70 () {60 vars in 1456 bytes} [Wed May 18 22:49:22 2022] DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments/027b8bbc-39f6-4907-bf76-911ac3300ad5 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 22:49:22.473260 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:22.474266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:22.481246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.481693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.482489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.482926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.512942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7471fc9a-e806-4d2d-9c99-b6bba32b73fc tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043698 May 18 22:49:22.513498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 376/746] 10.222.0.70 () {60 vars in 1342 bytes} [Wed May 18 22:49:22 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:49:22.643061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:22.643636 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:22.649745 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.650229 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.651084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.651513 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.675687 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:49:22.870360 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7663426b-90ca-40ac-a446-ccd6c4e5bbcf tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "DELETE /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 204 len: 0 microversion: 2.1 time: 0.231043 May 18 22:49:22.870858 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 371/747] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:49:22 2022] DELETE /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:49:22.878771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:22.879398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:22.885434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.885875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:22.887232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:22.887232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:23.015206 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:23.022558 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-50b1b8d5-28be-4123-8ceb-c27fb54754d7 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1508 microversion: 2.1 time: 0.147561 May 18 22:49:23.023119 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 377/748] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:22 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:23.097418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:23.098140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:23.105389 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:23.105829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:23.106629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:23.107061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:23.242748 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:23.250849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3bbfaba3-281a-4354-9a14-0bed6b34b9e1 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1264 microversion: 2.1 time: 0.157449 May 18 22:49:23.251368 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 372/749] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:23 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:23.524864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:23.526343 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:23.532375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:23.532832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:23.533621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:23.534079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:23.564248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-376d3312-76b8-40ad-b58b-13b0ac9cc382 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043458 May 18 22:49:23.564861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 378/750] 10.222.0.70 () {60 vars in 1342 bytes} [Wed May 18 22:49:23 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:49:24.040029 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:24.041152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:24.047734 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.048191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.048964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.049403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.182523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:24.189950 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-73517677-5737-42fc-8d32-116a2525bab9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1508 microversion: 2.1 time: 0.153892 May 18 22:49:24.190587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 373/751] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:24 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:24.268429 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:24.268959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:24.275161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.275604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.276361 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.276795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.409785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:24.418025 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e8122855-cd47-466f-a6bf-cc6a0b1e77d6 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1451 microversion: 2.1 time: 0.153552 May 18 22:49:24.418592 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 379/752] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:24 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:24.435601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:24.436207 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:24.442313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.442620 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.443416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.443852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.576511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:24.580377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:24.586928 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.588063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.588956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.589488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.630866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f0f35dee-db99-4f91-b1e4-53223fd8e22c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058431 May 18 22:49:24.631616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 380/753] 10.222.0.70 () {60 vars in 1342 bytes} [Wed May 18 22:49:24 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:49:24.653966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:24.661585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7b2784fd-f879-49da-bfb8-534cfcd9b71d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1451 microversion: 2.1 time: 0.230496 May 18 22:49:24.662195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 374/754] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:24 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1451 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:24.708803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:24.709293 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:24.716137 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.716585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.717395 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:24.717828 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:24.745444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:49:25.123106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c38fdf68-c5b9-4810-b4b0-c762f7cf39c0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 204 len: 0 microversion: 2.20 time: 0.417770 May 18 22:49:25.129070 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 381/755] 10.222.0.70 () {60 vars in 1279 bytes} [Wed May 18 22:49:24 2022] DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 22:49:25.141216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:25.148182 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:25.161587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:25.166840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:25.170657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:25.171290 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:25.194272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-04487a10-c08e-4c49-8c35-47e8e1129bac req-92a3c864-88eb-4900-a471-7875ab786c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76212507-6655-4eae-b27d-239e5e349b46", "name": "network-vif-deleted", "tag": "2ade8e46-0efa-484e-835b-4b4ce42c3411"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:25.202907 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-04487a10-c08e-4c49-8c35-47e8e1129bac req-92a3c864-88eb-4900-a471-7875ab786c4d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:25.203485 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-04487a10-c08e-4c49-8c35-47e8e1129bac req-92a3c864-88eb-4900-a471-7875ab786c4d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:25.215570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-04487a10-c08e-4c49-8c35-47e8e1129bac req-92a3c864-88eb-4900-a471-7875ab786c4d service nova] Creating event network-vif-deleted:2ade8e46-0efa-484e-835b-4b4ce42c3411 for instance 76212507-6655-4eae-b27d-239e5e349b46 on hv-cinder-83800 May 18 22:49:25.221015 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-04487a10-c08e-4c49-8c35-47e8e1129bac req-92a3c864-88eb-4900-a471-7875ab786c4d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 May 18 22:49:25.221641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 382/756] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:49:25.226815 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:25.227531 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:25.235020 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:25.235259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:25.236000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:25.236623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:25.348106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:25.362318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-354dcd09-1a8d-4de7-b461-0a79e1f298c9 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1466 microversion: 2.1 time: 0.139409 May 18 22:49:25.363065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 383/757] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:25 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:25.383683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:25.391991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:25.394110 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:25.395334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e9c37c83-d2b1-48d1-877d-0bca08f66ab6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.264560 May 18 22:49:25.396087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 375/758] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:25 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:26.379707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:26.380317 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:26.387508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:26.387962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:26.388737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:26.389176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:26.415561 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:26.416763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:26.435996 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:26.436458 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:26.437257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:26.438088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:26.459503 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:26.469058 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-64b77913-faa8-49eb-9912-7ca351f63ed5 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1466 microversion: 2.1 time: 0.093045 May 18 22:49:26.470339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 384/759] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:26 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1466 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:26.592467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:26.600843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:26.602355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:26.604201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9b01a2b3-752f-4d2c-9d12-3fce1d0cffda tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.192498 May 18 22:49:26.604771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 376/760] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:26 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:26.849732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-75948bb5-e5a7-4488-b052-b6739acd608e req-e198e680-8c44-4d49-a6ab-ce4be45b30ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d633259-1327-45ac-bc36-0db6e2a3ac0d", "tag": "2170f6d7-e113-4873-9f11-d973d6171ab9"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:26.858884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-75948bb5-e5a7-4488-b052-b6739acd608e req-e198e680-8c44-4d49-a6ab-ce4be45b30ef service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:26.859322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-75948bb5-e5a7-4488-b052-b6739acd608e req-e198e680-8c44-4d49-a6ab-ce4be45b30ef service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:26.870292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-75948bb5-e5a7-4488-b052-b6739acd608e req-e198e680-8c44-4d49-a6ab-ce4be45b30ef service nova] Creating event network-changed:2170f6d7-e113-4873-9f11-d973d6171ab9 for instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d on hv-cinder-83800 May 18 22:49:26.875278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-75948bb5-e5a7-4488-b052-b6739acd608e req-e198e680-8c44-4d49-a6ab-ce4be45b30ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029130 May 18 22:49:26.875863 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 385/761] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:27.486171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:27.486780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:27.492969 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:27.493414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:27.494710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:27.495141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:27.547850 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:27.548438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:27.548925 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'fault' on Instance uuid 76212507-6655-4eae-b27d-239e5e349b46 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:27.623656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:27.627180 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:27.634411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:27.635143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:27.636711 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:27.638824 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:27.639127 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:27.662337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ca12635c-703c-4286-aed3-67e9886a4f33 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 200 len: 1312 microversion: 2.1 time: 0.177390 May 18 22:49:27.663471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 377/762] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:27 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:27.880025 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:27.903114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:27.904662 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:27.906411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3b754277-bbe3-4d7a-8179-f2147e0b2653 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1724 microversion: 2.20 time: 0.287153 May 18 22:49:27.906981 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 386/763] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:27 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:49:28.684273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:28.688690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 76212507-6655-4eae-b27d-239e5e349b46] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:28.688690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:28.692534 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.693059 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.693915 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.694438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.698832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:28.708817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] HTTP exception thrown: Instance 76212507-6655-4eae-b27d-239e5e349b46 could not be found. May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Request method failure captured: May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 HTTP/1.1 May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYbjbQ_ZECXKziv0DZA2jsqDVXSP0EvU9dofmfutAYSWvDZ81U29vslocOQviFQ316tWoKBt7Od5qL1GEX7Hynj86iWvdoINgd-2xRnIap59pJ9KS4mUSM4YamWixkWBcVmES0W5IxsL_ag2L4ho9fS-O55lcqVreepKfvdP0j2q0s May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:49:28.713539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c184ebb6e93a4cd58d65d8fbe43c4760", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c184ebb6e93a4cd58d65d8fbe43c4760"}]}] May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: be51e8b84bb7471bb17409b331e599eb May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 76212507-6655-4eae-b27d-239e5e349b46 could not be found. May 18 22:49:28.714967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '76212507-6655-4eae-b27d-239e5e349b46'} May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76212507-6655-4eae-b27d-239e5e349b46 could not be found. May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:49:28.716030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76212507-6655-4eae-b27d-239e5e349b46 could not be found. May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76212507-6655-4eae-b27d-239e5e349b46 could not be found. May 18 22:49:28.717543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:28.718905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Returning 404 to user: Instance 76212507-6655-4eae-b27d-239e5e349b46 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:49:28.718905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-115bc662-ea7b-4f46-b010-944d53ee0f19 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46" status: 404 len: 111 microversion: 2.1 time: 0.033800 May 18 22:49:28.718905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 378/764] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:28 2022] GET /compute/v2.1/servers/76212507-6655-4eae-b27d-239e5e349b46 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:49:28.720464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:28.720952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:28.727279 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.727680 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.729030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.729500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.755258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:49:28.890947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-e05a7b30-1b84-4086-b3be-d7f29bf9c6ca req-2a15187d-bd4f-4dee-b978-09c3780c17cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e35b912-5d2e-451c-b856-af4bb422a6c0", "name": "network-vif-deleted", "tag": "96fba53d-5676-4c31-9cb9-19ddb31ada27"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:28.900594 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-e05a7b30-1b84-4086-b3be-d7f29bf9c6ca req-2a15187d-bd4f-4dee-b978-09c3780c17cb service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.901442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-e05a7b30-1b84-4086-b3be-d7f29bf9c6ca req-2a15187d-bd4f-4dee-b978-09c3780c17cb service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.910299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:28.912949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-e05a7b30-1b84-4086-b3be-d7f29bf9c6ca req-2a15187d-bd4f-4dee-b978-09c3780c17cb service nova] Creating event network-vif-deleted:96fba53d-5676-4c31-9cb9-19ddb31ada27 for instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 on hv-cinder-83800 May 18 22:49:28.922087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-e05a7b30-1b84-4086-b3be-d7f29bf9c6ca req-2a15187d-bd4f-4dee-b978-09c3780c17cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034724 May 18 22:49:28.923572 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 379/765] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:49:28.929464 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:28.930198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:28.937441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.937887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.938698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.939136 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.973385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7936e9d5-0f8e-44e7-a2cf-ce349b7863a6 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 204 len: 0 microversion: 2.1 time: 0.256440 May 18 22:49:28.973647 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.973935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.974081 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 387/766] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:49:28 2022] DELETE /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:49:28.974410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lazy-loading 'fault' on Instance uuid 8e35b912-5d2e-451c-b856-af4bb422a6c0 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:28.984561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:28.985341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:28.991608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.992127 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:28.992995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:28.993502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:29.019386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:29.029342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:29.030879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:29.032020 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ca4fee1b-b698-41e7-84c8-5b14d0729c6c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 200 len: 1371 microversion: 2.20 time: 0.107165 May 18 22:49:29.032577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 380/767] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:28 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:29.137318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:29.148421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5f47076c-c642-46e2-8ff8-0d55858cac64 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.170112 May 18 22:49:29.149168 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 388/768] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:28 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:49:30.051336 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:30.051944 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:30.060056 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:30.060513 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:30.061626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:30.061778 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:30.077009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] HTTP exception thrown: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Request method failure captured: May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 HTTP/1.1 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXalE9Q3wCiIh5n3KvwBtvzHdt9RDMr3i4uDk5C3ZpL2UCaGL25Ft_t8tDB3UnvntAuEZgFRAAd9XlPlmpTksJcBIqPSQAVx0w_xYjMU5m8gLcW-hO-ZWTlvjQd5AVVtlVgn5ztme50htBkWDIB7T9-IWtZYhpDc6ig34bqbGjHE9NE May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Openstack-Nova-Api-Version: 2.20 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:49:30.078678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a7373826e4743088ff1d782782b9890", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a7373826e4743088ff1d782782b9890"}]}] May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 2ffacb9e00b8448eb56a233a5d564d0e May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:49:30.080274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '8e35b912-5d2e-451c-b856-af4bb422a6c0'} May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:49:30.081194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:49:30.082658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:30.083930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Returning 404 to user: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:49:30.083930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-87602f48-908f-46ae-be24-5cc8e02c7dc1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 404 len: 111 microversion: 2.20 time: 0.033370 May 18 22:49:30.083930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 381/769] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:30 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 22:49:30.089730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7323129c-a62a-4f59-a148-a47fed3db670 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '.version_select at 0x7f6cd8ffa550>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:30.144689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7323129c-a62a-4f59-a148-a47fed3db670 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930455554" status: 204 len: 0 microversion: 2.20 time: 0.059238 May 18 22:49:30.145245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 389/770] 10.222.0.70 () {60 vars in 1261 bytes} [Wed May 18 22:49:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930455554 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 22:49:30.166916 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:30.167715 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:30.174645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:30.175026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:30.175782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:30.176211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:30.307973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:30.315545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c657101c-f936-4308-a3e0-7fc01492318c tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1522 microversion: 2.1 time: 0.153738 May 18 22:49:30.316104 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 382/771] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:30 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:30.943442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-80e020b4-a853-423c-a110-6ff808f93576 req-cd392cf3-2807-4692-be7e-d6b1a1031885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da5b596-3bb2-490e-b163-0649fbbc2657", "name": "network-vif-deleted", "tag": "fdb36b10-d6f4-4a5f-be73-d46b3a0b5721"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:30.949035 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-80e020b4-a853-423c-a110-6ff808f93576 req-cd392cf3-2807-4692-be7e-d6b1a1031885 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:30.949484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-80e020b4-a853-423c-a110-6ff808f93576 req-cd392cf3-2807-4692-be7e-d6b1a1031885 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:30.961465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-80e020b4-a853-423c-a110-6ff808f93576 req-cd392cf3-2807-4692-be7e-d6b1a1031885 service nova] Creating event network-vif-deleted:fdb36b10-d6f4-4a5f-be73-d46b3a0b5721 for instance 5da5b596-3bb2-490e-b163-0649fbbc2657 on hv-cinder-83800 May 18 22:49:30.967677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-80e020b4-a853-423c-a110-6ff808f93576 req-cd392cf3-2807-4692-be7e-d6b1a1031885 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033636 May 18 22:49:30.970218 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 390/772] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:31.049433 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c46a19fc-90f5-4867-8a4e-77052692bd74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'create', calling method: .version_select at 0x7f6cd8f109d0>, body: {"keypair": {"name": "tempest-keypair-731153388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCaCFrYcp2CKvGS4ajMhRuGSYCzB4N3h1k/lakMANEdCZCAPq00NmwsZYj0g+bV0+9QJsWbrxGOSfk/SeDyRD9lKlGazHBQ5JVIGe+eUZmIbtsUbwAoPWyPz5rnEF/67g=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:31.064546 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-c46a19fc-90f5-4867-8a4e-77052692bd74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for project 3a7373826e4743088ff1d782782b9890. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:49:31.069037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-c46a19fc-90f5-4867-8a4e-77052692bd74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for user 2ffacb9e00b8448eb56a233a5d564d0e and project 3a7373826e4743088ff1d782782b9890. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:49:31.174856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c46a19fc-90f5-4867-8a4e-77052692bd74 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.129487 May 18 22:49:31.175558 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 383/773] 10.222.0.70 () {62 vars in 1199 bytes} [Wed May 18 22:49:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 18 22:49:31.333454 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:31.334141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:31.340983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:31.341604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:31.342387 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:31.342827 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:31.373332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:31.373799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:31.374261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lazy-loading 'fault' on Instance uuid 5da5b596-3bb2-490e-b163-0649fbbc2657 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:49:31.420233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be51e8b84bb7471bb17409b331e599eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c184ebb6e93a4cd58d65d8fbe43c4760', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:31.425117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:31.430112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1f656b99-7958-4789-be53-c251374075aa tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 200 len: 1312 microversion: 2.1 time: 0.101058 May 18 22:49:31.431235 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 391/774] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:31 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:32.448245 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:32.449423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] [instance: 5da5b596-3bb2-490e-b163-0649fbbc2657] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:32.456148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:32.456683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:32.457385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:32.457767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:32.473080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] HTTP exception thrown: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 could not be found. May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Request method failure captured: May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 HTTP/1.1 May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYbjbQ_ZECXKziv0DZA2jsqDVXSP0EvU9dofmfutAYSWvDZ81U29vslocOQviFQ316tWoKBt7Od5qL1GEX7Hynj86iWvdoINgd-2xRnIap59pJ9KS4mUSM4YamWixkWBcVmES0W5IxsL_ag2L4ho9fS-O55lcqVreepKfvdP0j2q0s May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:49:32.474646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c184ebb6e93a4cd58d65d8fbe43c4760", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c184ebb6e93a4cd58d65d8fbe43c4760"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c184ebb6e93a4cd58d65d8fbe43c4760"}]}] May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: c184ebb6e93a4cd58d65d8fbe43c4760 May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2146618079 May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: be51e8b84bb7471bb17409b331e599eb May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2146618079-project May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 could not be found. May 18 22:49:32.476193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '5da5b596-3bb2-490e-b163-0649fbbc2657'} May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 could not be found. May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:49:32.477259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 could not be found. May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 could not be found. May 18 22:49:32.479077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:49:32.480543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] Returning 404 to user: Instance 5da5b596-3bb2-490e-b163-0649fbbc2657 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:49:32.480543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9ae47d83-4ca1-43d3-be8f-4c81f5424424 tempest-ServerRescueNegativeTestJSON-2146618079 tempest-ServerRescueNegativeTestJSON-2146618079-project] 10.222.0.70 "GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657" status: 404 len: 111 microversion: 2.1 time: 0.032380 May 18 22:49:32.485669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 384/775] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:32 2022] GET /compute/v2.1/servers/5da5b596-3bb2-490e-b163-0649fbbc2657 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:49:33.239295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-153773379", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ef8d9f04-cd89-47a5-92e7-968950a33380"}], "security_groups": [{"name": "tempest-securitygroup--594574427"}], "key_name": "tempest-keypair-731153388", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:33.612717 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] validate_networks() for [('ef8d9f04-cd89-47a5-92e7-968950a33380', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:49:34.270570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:49:34.271162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:49:34.271736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:49:34.272216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:49:34.272655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:49:34.282421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:34.282874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:34.283690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:34.284124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:34.302410 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for project 3a7373826e4743088ff1d782782b9890. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:49:34.306434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Getting quotas for user 2ffacb9e00b8448eb56a233a5d564d0e and project 3a7373826e4743088ff1d782782b9890. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:49:34.317959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:49:34.320273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:49:34.426993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0916b575-e367-4fed-8779-1d5b57aebdd9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.192442 May 18 22:49:34.427653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 392/776] 10.222.0.70 () {62 vars in 1187 bytes} [Wed May 18 22:49:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 22:49:34.438116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7c11034f-dc41-48c6-acdd-3eacdd375e02 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:34.438794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7c11034f-dc41-48c6-acdd-3eacdd375e02 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:34.518045 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7c11034f-dc41-48c6-acdd-3eacdd375e02 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:34.526194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7c11034f-dc41-48c6-acdd-3eacdd375e02 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:34.527778 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7c11034f-dc41-48c6-acdd-3eacdd375e02 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:34.529276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7c11034f-dc41-48c6-acdd-3eacdd375e02 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1280 microversion: 2.20 time: 0.094949 May 18 22:49:34.530171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 385/777] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:34 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:35.554541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:35.554541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:35.562242 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:35.562776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:35.563774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:35.564572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:35.628267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:35.640801 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:35.642437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:35.643799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-441a2b94-5aa0-477d-8c2a-a5adc1231308 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1284 microversion: 2.20 time: 0.095737 May 18 22:49:35.644528 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 393/778] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:35 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:36.661934 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:36.662515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:36.670899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:36.672606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:36.673493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:36.674116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:36.738803 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:36.747806 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:36.749303 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:36.750461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-571b6603-23dc-4bb1-b3ec-d762f3df3b7f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1340 microversion: 2.20 time: 0.092712 May 18 22:49:36.751003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 386/779] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:36 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:37.771515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:37.772305 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:37.783634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:37.784091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:37.784851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:37.785279 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:37.953016 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:37.962604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:37.964470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:37.965568 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ea4501af-7a54-4d85-9d5a-9a8cfa19539f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.199232 May 18 22:49:37.966155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 394/780] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:37 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:38.974052 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-effec1e7-6ae4-4f4c-ad8a-41ef05ec8fbb req-4ea5e21d-4f6b-44e1-bdd6-105c1cb9b742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:38.983854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:38.987144 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:38.988599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-effec1e7-6ae4-4f4c-ad8a-41ef05ec8fbb req-4ea5e21d-4f6b-44e1-bdd6-105c1cb9b742 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:38.989297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-effec1e7-6ae4-4f4c-ad8a-41ef05ec8fbb req-4ea5e21d-4f6b-44e1-bdd6-105c1cb9b742 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:38.991771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:38.992215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:38.994402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:38.996430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:39.010062 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-effec1e7-6ae4-4f4c-ad8a-41ef05ec8fbb req-4ea5e21d-4f6b-44e1-bdd6-105c1cb9b742 service nova] Creating event network-changed:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:49:39.015603 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-effec1e7-6ae4-4f4c-ad8a-41ef05ec8fbb req-4ea5e21d-4f6b-44e1-bdd6-105c1cb9b742 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045276 May 18 22:49:39.016906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 387/781] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:39.207629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:39.218271 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:39.220030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:39.221223 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-958baae9-e473-46a6-9bef-e47e4f7d8e72 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.241480 May 18 22:49:39.222426 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 395/782] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:38 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:40.241081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:40.241779 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:40.249150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:40.249600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:40.250411 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:40.251033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:40.700227 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:40.708606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:40.710139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:40.711263 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f3d1bcbe-280c-46a3-bee6-70e353ce51d1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.474957 May 18 22:49:40.711823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 388/783] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:40 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:41.730887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:41.731486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:41.737586 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:41.738304 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:41.739062 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:41.739489 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:41.985759 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:41.995403 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:41.996903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:41.998255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ef9ec6d8-aa83-4889-8c15-af3bba4435e3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.272001 May 18 22:49:41.998822 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 396/784] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:41 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:43.031653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:43.031653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:43.031653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:43.031653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:43.032498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:43.032498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:43.179008 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:43.191723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:43.194723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:43.194723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9d9dfd2d-e44f-4bde-9345-37e1b4e7ab7b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.182661 May 18 22:49:43.195688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 389/785] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:43 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:44.214506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:44.215155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:44.221773 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:44.222267 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:44.223044 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:44.223475 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:44.293054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:44.313191 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:44.317446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-744e1949-402f-4139-8df9-3d94155555a5 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: .version_select at 0x7f6cd8ffa820>, body: {"keypair": {"name": "tempest-keypair-1285274962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHZIfZeNo8In2Fkt0AbDpHqiDVbx9yZ+YOe7pCvxW7oURyGft2Has6+557Gbx0PeWbTwX6V0BR7xwKYGf2sgsbGVbtBUFxRVWF+xmQ30PzuyNKGDiBy5zTFWoWD762Wng=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:44.332795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-744e1949-402f-4139-8df9-3d94155555a5 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:49:44.337807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-744e1949-402f-4139-8df9-3d94155555a5 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for user 18d0bc67048c4bbb893f2589800c4535 and project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:49:44.369844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:44.375849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:44.377371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:44.378526 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd62a479-f7eb-4e2d-82a2-2438d3d4eba5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.168686 May 18 22:49:44.379089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 390/786] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:44 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:49:44.414875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-744e1949-402f-4139-8df9-3d94155555a5 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.233235 May 18 22:49:44.417381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 397/787] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:49:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:45.047754 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-9e5432c1-39b4-43d1-931a-3475cc623240 req-d7984258-5aa1-46f8-9418-49f2a370438a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "name": "network-vif-plugged", "status": "completed", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:45.055691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:45.058181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-9e5432c1-39b4-43d1-931a-3475cc623240 req-d7984258-5aa1-46f8-9418-49f2a370438a service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:45.061093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-9e5432c1-39b4-43d1-931a-3475cc623240 req-d7984258-5aa1-46f8-9418-49f2a370438a service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:45.075914 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-9e5432c1-39b4-43d1-931a-3475cc623240 req-d7984258-5aa1-46f8-9418-49f2a370438a service nova] Creating event network-vif-plugged:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:49:45.081159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-9e5432c1-39b4-43d1-931a-3475cc623240 req-d7984258-5aa1-46f8-9418-49f2a370438a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037179 May 18 22:49:45.081904 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 391/788] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:45.400648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:45.401469 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:45.407775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:45.408222 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:45.409516 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:45.410034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:45.560793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:45.568864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:45.570415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:45.571574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f32f1fa8-fb37-420a-90dd-8beac8f9844a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.178592 May 18 22:49:45.572131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 398/789] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:45 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:46.593050 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:46.594118 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:46.601266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:46.601837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:46.602724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:46.603524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:46.800350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2144790951", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68b3ef45-4681-44c9-a6ac-fa6061c84cda"}], "security_groups": [{"name": "tempest-securitygroup--156647548"}], "key_name": "tempest-keypair-1285274962", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:46.948612 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:46.950185 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] validate_networks() for [('68b3ef45-4681-44c9-a6ac-fa6061c84cda', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:49:46.957343 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:46.960330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:46.960330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d4bd899d-4711-4cb8-ac24-3483bd2b78ad tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1405 microversion: 2.20 time: 0.373692 May 18 22:49:46.961109 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 392/790] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:46 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1405 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:47.384758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:49:47.385179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:49:47.385658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:49:47.386091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:49:47.386523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:49:47.395517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:47.395969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:47.396773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:47.397212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:47.415741 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:49:47.419847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for user 18d0bc67048c4bbb893f2589800c4535 and project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:49:47.432058 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:49:47.434328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:49:47.524325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-76198e29-99ea-43f3-a66d-7d986f5ed717 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728958 May 18 22:49:47.526065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 399/791] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:49:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:49:47.535883 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4aa2add6-3a2e-4d23-b1e6-48e2ba43e833 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:47.536565 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4aa2add6-3a2e-4d23-b1e6-48e2ba43e833 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:47.606122 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4aa2add6-3a2e-4d23-b1e6-48e2ba43e833 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:47.614093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4aa2add6-3a2e-4d23-b1e6-48e2ba43e833 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1238 microversion: 2.1 time: 0.082015 May 18 22:49:47.625081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 393/792] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:47 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:47.979526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:47.980830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:47.987548 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:47.989056 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:47.989990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:47.990591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:48.137450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:48.145328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:48.146877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:48.148060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bee1775c-a6d9-4f62-b698-18681c2ccd4b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1597 microversion: 2.20 time: 0.173142 May 18 22:49:48.148616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 400/793] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:49:47 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1597 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:49:48.168217 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:48.168782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:48.176287 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:48.176737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:48.177501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:48.177927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:48.256977 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5026c7fc-4e3d-41a4-b222-ffa18ef7cc5c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093751 May 18 22:49:48.257568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 394/794] 10.222.0.70 () {60 vars in 1315 bytes} [Wed May 18 22:49:48 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:49:48.631011 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:48.632212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:48.640987 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:48.641435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:48.642266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:48.642699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:48.731914 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:48.737878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4981d26b-03c8-4094-8b1e-862d44b77042 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1242 microversion: 2.1 time: 0.110813 May 18 22:49:48.738481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 401/795] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:48 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1242 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:49.288746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-c140e6cf-6eb4-40c1-a595-e53723c21bd3 req-37bb256b-7849-4add-8780-0ebd87568011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:49.297152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c140e6cf-6eb4-40c1-a595-e53723c21bd3 req-37bb256b-7849-4add-8780-0ebd87568011 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:49.303362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c140e6cf-6eb4-40c1-a595-e53723c21bd3 req-37bb256b-7849-4add-8780-0ebd87568011 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:49.309308 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-c140e6cf-6eb4-40c1-a595-e53723c21bd3 req-37bb256b-7849-4add-8780-0ebd87568011 service nova] Creating event network-changed:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:49:49.314299 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-c140e6cf-6eb4-40c1-a595-e53723c21bd3 req-37bb256b-7849-4add-8780-0ebd87568011 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029584 May 18 22:49:49.314839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 395/796] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:49:49.756069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:49.756677 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:49.765111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:49.765842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:49.766813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:49.767416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:49.839477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:49.847441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ad2a9e50-b95b-44ed-b71d-15124c356801 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1290 microversion: 2.1 time: 0.095295 May 18 22:49:49.848041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 402/797] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:49 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:49.971008 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:49.975414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:49.980148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:49.980982 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:49.982159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:49.982825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:50.010313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-370177eb-3e53-423a-9659-4a530d5decb1 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/ips" status: 200 len: 148 microversion: 2.1 time: 0.043496 May 18 22:49:50.011818 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 396/798] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:49:49 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/ips => generated 148 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:50.868999 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:50.869575 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:50.875945 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:50.876741 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:50.880924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:50.880924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:50.952623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:50.960185 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6f7e6dd7-10c1-422b-945a-154cf0d5bd57 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1296 microversion: 2.1 time: 0.095181 May 18 22:49:50.960756 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 403/799] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:50 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:51.977860 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:51.978499 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:51.984950 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:51.985399 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:51.986260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:51.986698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:52.010054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-aa46511f-2dfc-487f-90a5-92c413c2c5cb req-e689e1dd-2437-4cb4-a325-58cabccc6ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb83799d-978a-401d-9194-46c104e85cf9", "tag": "ae773bbc-f6df-49bb-ac08-6fa413e7c067"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:52.022901 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-aa46511f-2dfc-487f-90a5-92c413c2c5cb req-e689e1dd-2437-4cb4-a325-58cabccc6ed2 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:52.023413 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-aa46511f-2dfc-487f-90a5-92c413c2c5cb req-e689e1dd-2437-4cb4-a325-58cabccc6ed2 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:52.038832 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-aa46511f-2dfc-487f-90a5-92c413c2c5cb req-e689e1dd-2437-4cb4-a325-58cabccc6ed2 service nova] Creating event network-changed:ae773bbc-f6df-49bb-ac08-6fa413e7c067 for instance bb83799d-978a-401d-9194-46c104e85cf9 on hv-cinder-83800 May 18 22:49:52.042020 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-aa46511f-2dfc-487f-90a5-92c413c2c5cb req-e689e1dd-2437-4cb4-a325-58cabccc6ed2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036962 May 18 22:49:52.050842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 404/800] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:49:52.193633 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:52.201276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-69ec0a32-0b0c-4c5d-9a03-2daa29bbc2a3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.227290 May 18 22:49:52.201924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 397/801] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:51 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:52.735035 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b64ec1-3492-419f-b59f-1c1f791b1d28"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:52.736106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:52.742210 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:52.742659 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:52.743529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:52.743999 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:53.218025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:53.218644 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:53.225130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:53.225578 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:53.226378 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:53.226818 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:53.358732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:53.366031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f1f983b7-0aac-4f21-8265-22065505ddac tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.151914 May 18 22:49:53.366588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 398/802] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:53 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:49:54.383209 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:54.384458 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:54.390877 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:54.391316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:54.392075 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:54.392506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:54.522819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:54.530355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8e61d1bb-18ee-4118-b46d-69c89f7492d4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.150936 May 18 22:49:54.530920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 399/803] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:54 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:49:55.547437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:55.548781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:55.556062 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:55.556515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:55.557296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:55.557766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:55.696906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:55.704408 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8ddabeaa-42f8-4202-b2c6-bf68fd6b638d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.161140 May 18 22:49:55.704980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 400/804] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:55 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:49:55.737117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1cf9a6b0-999a-4730-919a-9fbcac2dc4fc tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.006086 May 18 22:49:55.742456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 405/805] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:49:52 2022] POST /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments => generated 194 bytes in 3008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:56.721353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:56.721898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:56.729498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:56.729985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:56.730784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:56.731223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:56.862838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:56.870219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-37715e6f-a4ce-4f7d-bbce-10477e4e083b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.152788 May 18 22:49:56.870783 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 401/806] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:56 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:57.075949 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-3a32ab73-7990-403b-a90c-0831c647e90d req-18360341-f78d-43ca-8163-c730c489ea24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb83799d-978a-401d-9194-46c104e85cf9", "name": "network-vif-plugged", "status": "completed", "tag": "ae773bbc-f6df-49bb-ac08-6fa413e7c067"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:49:57.084885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3a32ab73-7990-403b-a90c-0831c647e90d req-18360341-f78d-43ca-8163-c730c489ea24 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:57.086273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3a32ab73-7990-403b-a90c-0831c647e90d req-18360341-f78d-43ca-8163-c730c489ea24 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:57.096121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-3a32ab73-7990-403b-a90c-0831c647e90d req-18360341-f78d-43ca-8163-c730c489ea24 service nova] Creating event network-vif-plugged:ae773bbc-f6df-49bb-ac08-6fa413e7c067 for instance bb83799d-978a-401d-9194-46c104e85cf9 on hv-cinder-83800 May 18 22:49:57.100784 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-3a32ab73-7990-403b-a90c-0831c647e90d req-18360341-f78d-43ca-8163-c730c489ea24 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 May 18 22:49:57.101416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 406/807] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:49:57.887252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:57.887940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:57.896359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:57.903406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:57.903862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:57.904647 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:57.905087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:58.041901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:58.045540 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:58.050273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-066c91ed-11f8-45f3-809d-333f29e22cf8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.168051 May 18 22:49:58.050840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 402/808] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:57 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:49:59.065018 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:59.065862 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=10 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:49:59.070467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:49:59.076884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:49:59.077916 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:59.078398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:59.079157 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:49:59.079592 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:49:59.212754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:49:59.220391 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cdcd55b4-6079-4a46-812f-a33161815176 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1363 microversion: 2.1 time: 0.156306 May 18 22:49:59.221518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 407/809] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:49:59 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:00.238350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:00.240936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:00.240936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:00.245878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:00.246353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:00.247184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:00.247624 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:00.380221 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:00.388336 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9ea9f62d-3ea5-4207-8fcb-c738e3b4fff8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1550 microversion: 2.1 time: 0.154381 May 18 22:50:00.389813 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 403/810] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:00 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1550 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:00.404880 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:00.405365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:00.407668 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:00.412846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:00.412846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:00.413580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:00.414032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:00.491688 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-378733a9-ef6e-4614-8d72-f8e0e8c0a24f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090581 May 18 22:50:00.492284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 408/811] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:50:00 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:01.476315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-edce4eb1-54a8-42ed-9404-2a3002bce3ca req-f1e754fd-82c6-4619-8146-215d51b84210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb83799d-978a-401d-9194-46c104e85cf9", "tag": "ae773bbc-f6df-49bb-ac08-6fa413e7c067"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:01.484897 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-edce4eb1-54a8-42ed-9404-2a3002bce3ca req-f1e754fd-82c6-4619-8146-215d51b84210 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:01.485410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-edce4eb1-54a8-42ed-9404-2a3002bce3ca req-f1e754fd-82c6-4619-8146-215d51b84210 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:01.496538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-edce4eb1-54a8-42ed-9404-2a3002bce3ca req-f1e754fd-82c6-4619-8146-215d51b84210 service nova] Creating event network-changed:ae773bbc-f6df-49bb-ac08-6fa413e7c067 for instance bb83799d-978a-401d-9194-46c104e85cf9 on hv-cinder-83800 May 18 22:50:01.501362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-edce4eb1-54a8-42ed-9404-2a3002bce3ca req-f1e754fd-82c6-4619-8146-215d51b84210 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028775 May 18 22:50:01.501958 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 404/812] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:04.283052 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17b64ec1-3492-419f-b59f-1c1f791b1d28"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:04.284153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:04.290347 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.290787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.291543 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.291971 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.295495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:04.372515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Invalid volume: volume 17b64ec1-3492-419f-b59f-1c1f791b1d28 is already attached to instances: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: POST /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments HTTP/1.1 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 74 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:50:04.374255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {"volumeAttachment": {"volumeId": "17b64ec1-3492-419f-b59f-1c1f791b1d28"}} May 18 22:50:04.375878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Invalid volume: volume 17b64ec1-3492-419f-b59f-1c1f791b1d28 is already attached to instances: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'server_id': 'a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4', 'body': {'volumeAttachment': {'volumeId': '17b64ec1-3492-419f-b59f-1c1f791b1d28'}}} May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17b64ec1-3492-419f-b59f-1c1f791b1d28 is already attached to instances: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:04.376716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17b64ec1-3492-419f-b59f-1c1f791b1d28 is already attached to instances: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:50:04.377960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17b64ec1-3492-419f-b59f-1c1f791b1d28 is already attached to instances: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 400 to user: Invalid volume: volume 17b64ec1-3492-419f-b59f-1c1f791b1d28 is already attached to instances: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d985a87a-5cf0-4a2e-8e18-d79eb9c418ba tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097497 May 18 22:50:04.379250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 409/813] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:50:04 2022] POST /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 22:50:04.439168 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:04.439736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:04.446366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.447119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.447914 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.448349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.527722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'services' on Instance uuid a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:50:04.715524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b9aa1178-ebe8-44cd-9e04-5a1b72fce3eb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments/17b64ec1-3492-419f-b59f-1c1f791b1d28" status: 202 len: 0 microversion: 2.1 time: 0.280406 May 18 22:50:04.716127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 405/814] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:50:04 2022] DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments/17b64ec1-3492-419f-b59f-1c1f791b1d28 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:50:04.725116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:04.726800 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:04.734190 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.734639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.735398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.735877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.765416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a99fe05b-d596-4de0-a396-dfaf2e2a06bb tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 May 18 22:50:04.765973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 410/815] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:50:04 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:04.956093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:04.956701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:04.963523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.963964 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.964716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:04.965148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:04.987148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lazy-loading 'flavor' on Instance uuid c850c82e-2876-4797-8a76-d09960544a2f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:50:05.336127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0ece1f76-4b1c-424f-b27c-44e270c1d9cf tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "POST /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f/action" status: 202 len: 0 microversion: 2.1 time: 0.384070 May 18 22:50:05.337584 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 406/816] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:50:04 2022] POST /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:50:05.346287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:05.346959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:05.354516 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:05.355007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:05.355807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:05.356244 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:05.495646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:05.503831 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ce0457a0-fad1-4b03-a0d4-55c6cf7f1ba0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.161742 May 18 22:50:05.504433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 411/817] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:05 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:05.778659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:05.779716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:05.785819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:05.786295 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:05.787079 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:05.787509 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:05.817500 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-36b69283-4ccf-4f4b-bd56-332567a25e6c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 May 18 22:50:05.818078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 407/818] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:50:05 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:06.521623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:06.522259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:06.528846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:06.529298 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:06.530099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:06.530539 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:06.661625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:06.669899 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-86003405-e8eb-4fbf-8d9f-d0ffccbc4e44 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.152089 May 18 22:50:06.670504 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 412/819] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:06 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:06.829184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:06.830115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:06.836590 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:06.837041 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:06.837973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:06.838538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:06.866886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c17a2a63-5eec-4a37-97c6-50e81a9934d6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041733 May 18 22:50:06.867440 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 408/820] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:50:06 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:50:06.925086 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:06.925580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:06.932468 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:06.932913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:06.933673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:06.934133 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:06.958628 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:50:07.240734 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c8a751f9-8b6f-49fd-a05a-9c35815be6a6 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 204 len: 0 microversion: 2.1 time: 0.319484 May 18 22:50:07.241314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 413/821] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:50:06 2022] DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:50:07.249611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:07.250240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:07.256252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:07.256693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:07.257447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:07.257872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:07.389285 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:07.396780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-204ab37e-50ac-468b-8e78-3a2eac4d7b9e tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1679 microversion: 2.1 time: 0.151209 May 18 22:50:07.397345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 409/822] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:07 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:07.688101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:07.688803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:07.695351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:07.696312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:07.697079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:07.697518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:07.827520 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:07.835021 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-17abfdb0-2c9b-4035-a703-d3461ca6dba9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.151161 May 18 22:50:07.835587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 414/823] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:07 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:08.415002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:08.415586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:08.422459 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:08.425081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:08.425081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:08.425081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:08.557638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:08.565148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-adcf84d5-8f44-4b74-b31f-f82b9a2221be tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1679 microversion: 2.1 time: 0.154198 May 18 22:50:08.565705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 410/824] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:08 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:08.852599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:08.853170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:08.859373 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:08.860067 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:08.860592 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:08.861020 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:08.993552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:09.000974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c5a18bf1-4a6c-4629-a024-ab12df08e2e0 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.152595 May 18 22:50:09.001538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 415/825] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:08 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:09.583793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:09.584413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:09.591425 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:09.591871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:09.592631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:09.593060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:10.018106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:10.018670 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:10.025859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:10.026333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:10.027104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:10.027539 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:10.080192 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:10.088375 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e2baa658-7cf8-4d9b-b60c-3d636d077e77 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1679 microversion: 2.1 time: 0.508474 May 18 22:50:10.089034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 411/826] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:09 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1679 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:10.235266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:10.243351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b3280d85-7519-489b-9f60-878042a29c25 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.228978 May 18 22:50:10.244121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 416/827] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:10 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:10.679676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-a49befc1-4127-4183-8494-d8d79982407f req-96af89b3-470c-402e-9ffa-beb1df67eb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4", "name": "network-vif-deleted", "tag": "97bbf516-76d1-4de0-b9b6-cb94305e0a32"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:10.689076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a49befc1-4127-4183-8494-d8d79982407f req-96af89b3-470c-402e-9ffa-beb1df67eb67 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:10.689600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a49befc1-4127-4183-8494-d8d79982407f req-96af89b3-470c-402e-9ffa-beb1df67eb67 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:10.700727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-a49befc1-4127-4183-8494-d8d79982407f req-96af89b3-470c-402e-9ffa-beb1df67eb67 service nova] Creating event network-vif-deleted:97bbf516-76d1-4de0-b9b6-cb94305e0a32 for instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 on hv-cinder-83800 May 18 22:50:10.705657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-a49befc1-4127-4183-8494-d8d79982407f req-96af89b3-470c-402e-9ffa-beb1df67eb67 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030017 May 18 22:50:10.706247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 412/828] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:11.105266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:11.105833 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:11.112434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:11.112886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:11.113699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:11.114164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:11.147044 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:11.147494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:11.147946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'fault' on Instance uuid a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:50:11.190038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:11.198481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b4c9b3c7-37d7-45cd-9c21-b3af923b0485 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 200 len: 1331 microversion: 2.1 time: 0.097141 May 18 22:50:11.199055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 417/829] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:11 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:11.261724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:11.262547 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:11.268810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:11.269330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:11.270144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:11.270578 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:11.409666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:11.416583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-62d23270-a5d7-4b76-ad40-34096ceeff1b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.159571 May 18 22:50:11.417167 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 413/830] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:11 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:12.215135 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:12.215736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:12.222266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:12.222710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:12.223460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:12.223891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:12.237573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 HTTP/1.1 May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:50:12.239186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:50:12.240666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4'} May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:50:12.241500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:50:12.243118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:50:12.245172 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:50:12.245172 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-300d0119-beff-4bb6-adff-275f24163e87 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 404 len: 111 microversion: 2.1 time: 0.029323 May 18 22:50:12.245172 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 418/831] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:12 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:50:12.250296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-14689d3d-092c-4804-b48e-f3ee814a2d33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '.version_select at 0x7f6cd903aee0>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:12.320073 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-14689d3d-092c-4804-b48e-f3ee814a2d33 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631777844" status: 202 len: 0 microversion: 2.1 time: 0.074010 May 18 22:50:12.320579 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 414/832] 10.222.0.70 () {58 vars in 1220 bytes} [Wed May 18 22:50:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631777844 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:50:12.435347 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:12.435956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:12.441997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:12.442469 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:12.446814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:12.446814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:12.668769 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:12.676599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c8ec2f95-2946-44f5-9a68-ecd822c56237 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.246048 May 18 22:50:12.677166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 419/833] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:12 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:13.095541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-683ada67-8ea1-4263-b426-049360b99128 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: .version_select at 0x7f6cd8fed8b0>, body: {"keypair": {"name": "tempest-keypair-1466311286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeSKqmIYEQFiq/z5A08hVJqE1dd6UgzV5krddOkWnWfZ9kIejEi0VZY4u1YZZmAsENJKKZy9PE1Z4yHxYfpmWiExdc00q/QnCnCWkMQgku9v4xWl3bgL7S/NVdG7Ine4w=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:13.112002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-683ada67-8ea1-4263-b426-049360b99128 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:50:13.115837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-683ada67-8ea1-4263-b426-049360b99128 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:50:13.196059 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-683ada67-8ea1-4263-b426-049360b99128 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104337 May 18 22:50:13.196766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 415/834] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:50:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:13.693363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:13.693962 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:13.700733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:13.701162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:13.701917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:13.702375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:13.851752 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:13.859886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2d7c4c64-e9b5-4d1d-a24a-748b86938141 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.170409 May 18 22:50:13.860445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 420/835] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:13 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:14.877314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:14.878054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:14.884104 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:14.885177 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:14.886316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:14.886758 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:15.076981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:15.084696 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fdce5799-722d-47fc-bc8b-eaad5115566e tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.211847 May 18 22:50:15.085259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 416/836] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:14 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:15.367624 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-297307071", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbd3cb94-6b06-443d-a376-6f705f586753"}], "security_groups": [{"name": "tempest-securitygroup--2045580912"}], "key_name": "tempest-keypair-1466311286", "user_data": "}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:15.468420 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] validate_networks() for [('fbd3cb94-6b06-443d-a376-6f705f586753', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:50:15.912404 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:50:15.913385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:50:15.913943 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:50:15.914453 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:50:15.915432 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:50:15.925715 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:15.926231 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:15.927044 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:15.927487 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:15.944309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:50:15.948983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Getting quotas for user f2b45df9a7cd466593d5c8a4f30bde53 and project 6422f1b1118143e4b8ef54927212ca97. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:50:15.960723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:50:15.963808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:50:16.087445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-617e8148-968d-4a25-936d-aa2b5aea20cf tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.724076 May 18 22:50:16.088308 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 421/837] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:50:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:50:16.100671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8a5b6ade-a2d5-4178-a88c-786961c7ef04 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:16.101352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:16.102157 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:16.102705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8a5b6ade-a2d5-4178-a88c-786961c7ef04 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:16.108929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:16.109372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:16.110253 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:16.110690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:16.211575 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8a5b6ade-a2d5-4178-a88c-786961c7ef04 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:16.219144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8a5b6ade-a2d5-4178-a88c-786961c7ef04 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1241 microversion: 2.1 time: 0.124811 May 18 22:50:16.219725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 417/838] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:16 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:16.365824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:16.374407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bf8c14e3-315a-4dd3-b49d-e100b3bff2b7 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.276830 May 18 22:50:16.375030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 422/839] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:16 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:17.236838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:17.237442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:17.245699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:17.246170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:17.246925 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:17.247355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:17.307862 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:17.315148 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-82970555-d44e-4aa6-b7d3-6ca5161ef8f3 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1245 microversion: 2.1 time: 0.082181 May 18 22:50:17.315705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 418/840] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:17 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:17.390816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:17.391434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:17.398093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:17.398546 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:17.399309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:17.399750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:17.536783 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:17.544892 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-66a7c2ad-f4d3-47c5-b0fc-e6f8dbe28940 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.157851 May 18 22:50:17.545451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 423/841] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:17 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:18.332198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:18.332750 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:18.339281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:18.339740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:18.340497 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:18.340931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:18.403092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:18.410755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3fc7ac31-d169-4ce1-90fa-2e2d0e4ebb53 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1237 microversion: 2.1 time: 0.082464 May 18 22:50:18.411325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 419/842] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:18 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:18.562803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:18.563421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:18.570112 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:18.570566 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:18.571357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:18.571825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:18.701353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:18.708856 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-377011e6-dcf1-46a2-8581-8d9ed08708d8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.149998 May 18 22:50:18.709420 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 424/843] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:18 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:19.427751 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:19.428358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:19.435063 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:19.435508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:19.436268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:19.436701 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:19.520924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:19.529900 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8e41b1d3-75c2-4215-bacf-996d249a769d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1299 microversion: 2.1 time: 0.105954 May 18 22:50:19.530563 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 420/844] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:19 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:19.726312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:19.726913 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:19.733404 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:19.733845 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:19.734631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:19.735092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:19.737863 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:19.994400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:19.994400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5bdb41d5-ccf4-4668-8073-42146d53225a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1566 microversion: 2.1 time: 0.264003 May 18 22:50:19.994400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 425/845] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:19 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:20.004504 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:20.005206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:20.013104 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:20.013580 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:20.014482 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:20.014930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:20.019986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:20.303985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ec6a602d-2ce3-425e-ad9d-7893e71f2ef5 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "POST /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f/action" status: 202 len: 0 microversion: 2.1 time: 0.303570 May 18 22:50:20.304917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 421/846] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:50:19 2022] POST /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:50:20.313636 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:20.314289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:20.320758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:20.321215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:20.322210 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:20.323185 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:20.535288 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:20.541517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-01bd66a6-276a-4623-85a0-b23c6f9a0029 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1514 microversion: 2.1 time: 0.231729 May 18 22:50:20.543393 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 426/847] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:20 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:20.549088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:20.549695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:20.556175 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:20.556622 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:20.557388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:20.557819 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:20.725587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:20.734093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-926c892b-a567-402e-9083-3e67b0aaeb64 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.189986 May 18 22:50:20.734733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 422/848] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:20 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:21.162732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-ba89b1de-47c7-47e9-88cb-992d1c30c611 req-f1de9ca5-4621-4d16-97af-cd5df1006731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d5eb2-2c7f-4e0a-b023-4b694bc2f27b", "tag": "6bf1412b-0088-4128-af97-c8d46ee4b076"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:21.184949 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ba89b1de-47c7-47e9-88cb-992d1c30c611 req-f1de9ca5-4621-4d16-97af-cd5df1006731 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:21.185404 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ba89b1de-47c7-47e9-88cb-992d1c30c611 req-f1de9ca5-4621-4d16-97af-cd5df1006731 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:21.202024 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-ba89b1de-47c7-47e9-88cb-992d1c30c611 req-f1de9ca5-4621-4d16-97af-cd5df1006731 service nova] Creating event network-changed:6bf1412b-0088-4128-af97-c8d46ee4b076 for instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b on hv-cinder-83800 May 18 22:50:21.207570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-ba89b1de-47c7-47e9-88cb-992d1c30c611 req-f1de9ca5-4621-4d16-97af-cd5df1006731 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063200 May 18 22:50:21.210617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 427/849] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:21.560293 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:21.560897 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:21.567342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:21.567788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:21.568553 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:21.568980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:21.752729 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:21.753871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:21.760517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:21.761019 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:21.762145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:21.762617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:22.132706 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:22.140993 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b0a381e2-206b-4153-8aaa-66f8efa6db1f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1516 microversion: 2.1 time: 0.585136 May 18 22:50:22.141168 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:22.141617 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 423/850] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:21 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1516 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:22.154922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9889b47a-6739-43c2-9dd5-124daa4f1011 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.406532 May 18 22:50:22.158134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 428/851] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:21 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:23.104302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-f451630d-2816-44fa-a2e5-21224cad0d62 req-1f1a848a-7e13-4d78-874c-7be4b66a9b7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "name": "network-vif-unplugged", "status": "completed", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:23.116266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-f451630d-2816-44fa-a2e5-21224cad0d62 req-1f1a848a-7e13-4d78-874c-7be4b66a9b7d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:23.116266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-f451630d-2816-44fa-a2e5-21224cad0d62 req-1f1a848a-7e13-4d78-874c-7be4b66a9b7d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:23.124990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.compute.server_external_events [req-f451630d-2816-44fa-a2e5-21224cad0d62 req-1f1a848a-7e13-4d78-874c-7be4b66a9b7d service nova] Unable to find a host for instance c850c82e-2876-4797-8a76-d09960544a2f. Dropping event network-vif-unplugged {{(pid=124366) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 18 22:50:23.125852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-f451630d-2816-44fa-a2e5-21224cad0d62 req-1f1a848a-7e13-4d78-874c-7be4b66a9b7d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025852 May 18 22:50:23.126498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 424/852] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 22:50:23.158552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:23.159157 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:23.165251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:23.165688 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:23.166503 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:23.166945 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:23.172995 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:23.173731 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:23.179920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:23.180370 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:23.181144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:23.181588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:23.367365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:23.375156 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-901ad51a-392f-48c0-8f6e-6858be5ffb4a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1516 microversion: 2.1 time: 0.220534 May 18 22:50:23.376045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 429/853] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:23 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:23.378545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:23.386380 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-80598e54-ab49-4d02-832f-c7c292277c76 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.217319 May 18 22:50:23.387128 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 425/854] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:23 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:24.392425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:24.393038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:24.399842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:24.408140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:24.408140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:24.408140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:24.408461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:24.408461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:24.410427 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:24.410875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:24.411635 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:24.412076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:24.599461 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:24.602377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:24.607781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d763fde7-ad10-49eb-95d1-950e90df6a01 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1516 microversion: 2.1 time: 0.219264 May 18 22:50:24.608376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 430/855] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:24 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:24.610975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9903b434-c24b-4a77-aab2-202ce6e43c19 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.211446 May 18 22:50:24.611531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 426/856] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:24 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:25.625642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:25.626295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:25.628106 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:25.628715 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:25.632727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:25.633171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:25.633929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:25.634392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:25.635247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:25.635694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:25.636510 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:25.636949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:25.888294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:25.896155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-75c278e3-e339-4a77-bc39-8a2e66d9f922 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.274790 May 18 22:50:25.897053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 431/857] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:25 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:25.897446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:25.905954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1731ed66-8f4d-4d96-8236-a0a49cf5af83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.281526 May 18 22:50:25.906571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 427/858] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:25 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:26.913786 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:26.914425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:26.916459 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:26.917116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:26.923595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:26.923998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:26.924441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:26.924561 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:26.924957 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:26.925398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:26.926137 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:26.931454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:26.931902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:26.932657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:26.933084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:27.125820 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:27.128703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:27.133616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ca38432f-357c-48e7-ba0b-c7e18aa92697 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.223574 May 18 22:50:27.134535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 432/859] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:26 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:27.137618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d8529b9b-19fa-4590-8a3f-2d5e0834ef69 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.218501 May 18 22:50:27.138286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 428/860] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:26 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:27.235804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-36f737fa-8822-4b85-acf4-2f9fe3daee69 req-18992f96-da16-4f1e-aa0c-3a726bd68a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532d5eb2-2c7f-4e0a-b023-4b694bc2f27b", "name": "network-vif-plugged", "status": "completed", "tag": "6bf1412b-0088-4128-af97-c8d46ee4b076"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:27.243632 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-36f737fa-8822-4b85-acf4-2f9fe3daee69 req-18992f96-da16-4f1e-aa0c-3a726bd68a00 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:27.246417 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-36f737fa-8822-4b85-acf4-2f9fe3daee69 req-18992f96-da16-4f1e-aa0c-3a726bd68a00 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:27.254828 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-36f737fa-8822-4b85-acf4-2f9fe3daee69 req-18992f96-da16-4f1e-aa0c-3a726bd68a00 service nova] Creating event network-vif-plugged:6bf1412b-0088-4128-af97-c8d46ee4b076 for instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b on hv-cinder-83800 May 18 22:50:27.259686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-36f737fa-8822-4b85-acf4-2f9fe3daee69 req-18992f96-da16-4f1e-aa0c-3a726bd68a00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028205 May 18 22:50:27.260262 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 433/861] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:28.151254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:28.151786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:28.155463 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:28.156169 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:28.159152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:28.159600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:28.160359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:28.160788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:28.162597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:28.163050 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:28.163925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:28.164365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:28.357341 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:28.360427 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:28.365766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c5f55949-694b-4649-bcdd-f5de64612e15 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.218563 May 18 22:50:28.366640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 429/862] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:28 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:28.368014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3823bf77-ce66-49fe-8425-41a1927da0b2 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.218018 May 18 22:50:28.368642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 434/863] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:28 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:29.383017 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:29.385471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:29.385591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:29.385591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:29.390823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:29.391274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:29.391649 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:29.392054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:29.392170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:29.392515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:29.392875 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:29.393303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:29.595267 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:29.598595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:29.602861 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-57b0a773-c28b-41ad-8a39-e415a55df729 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.224226 May 18 22:50:29.603441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 430/864] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:29 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:29.609355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b85a2306-d091-4542-8542-353dd8d65c49 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1367 microversion: 2.1 time: 0.228664 May 18 22:50:29.614792 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 435/865] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:29 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:50:30.620620 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:30.621231 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:30.624508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:30.629614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:30.629879 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:30.630363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:30.630524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:30.630829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:30.631257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:30.636998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:30.637554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:30.638319 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:30.638761 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:30.832835 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:30.836898 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:30.840353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-02f376d2-b65d-42bf-ac28-e74e8a668d4f tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.223586 May 18 22:50:30.841898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 431/866] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:30 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:30.845038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3042bc1b-2ef3-4bad-aaa9-7b1e47d5d5c8 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1556 microversion: 2.1 time: 0.219019 May 18 22:50:30.845595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 436/867] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:30 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1556 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:30.862117 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:30.865152 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:30.868888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:30.869332 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:30.870121 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:30.870559 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:30.947469 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-940cb732-efc3-4c84-9def-c1290276fe00 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089460 May 18 22:50:30.948098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 432/868] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:50:30 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:31.859271 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:31.859859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:31.866311 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:31.866756 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:31.867521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:31.867951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:31.944914 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-6754e34e-c898-4a7c-97e7-516828b720c6 req-513baf54-91ab-4826-a28a-28aa87e186f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "532d5eb2-2c7f-4e0a-b023-4b694bc2f27b", "tag": "6bf1412b-0088-4128-af97-c8d46ee4b076"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:31.953990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-6754e34e-c898-4a7c-97e7-516828b720c6 req-513baf54-91ab-4826-a28a-28aa87e186f6 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:31.954691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-6754e34e-c898-4a7c-97e7-516828b720c6 req-513baf54-91ab-4826-a28a-28aa87e186f6 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:31.966737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-6754e34e-c898-4a7c-97e7-516828b720c6 req-513baf54-91ab-4826-a28a-28aa87e186f6 service nova] Creating event network-changed:6bf1412b-0088-4128-af97-c8d46ee4b076 for instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b on hv-cinder-83800 May 18 22:50:31.972403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-6754e34e-c898-4a7c-97e7-516828b720c6 req-513baf54-91ab-4826-a28a-28aa87e186f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031530 May 18 22:50:31.973096 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 433/869] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:32.015985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:32.024643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f627c26d-ede4-4a8e-bf03-7f6d0d0c002b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.169774 May 18 22:50:32.025436 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 437/870] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:31 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:33.042680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:33.043422 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:33.050073 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:33.050527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:33.051288 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:33.051722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:33.187114 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:33.194564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-062aaad9-a863-4dea-845f-0bc3a646ab40 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.156596 May 18 22:50:33.195129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 434/871] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:33 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:34.211496 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:34.212107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:34.218846 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:34.219294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:34.220051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:34.220512 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:34.349746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:34.357854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fce2c91f-3c97-4a86-beb9-394166ef593a tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.150184 May 18 22:50:34.358464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 438/872] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:34 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:35.375130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:35.375719 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:35.383296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:35.383744 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:35.384501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:35.384930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:35.521843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:35.529348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-11c5e7e5-7ed5-4829-a023-68017d831b91 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.158314 May 18 22:50:35.529908 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 435/873] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:35 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:36.546792 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:36.547401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:36.549808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:50:36.554558 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:36.555008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:36.555770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:36.556203 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:36.691918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:36.699641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-113d18a4-f5fd-405d-95e2-6e4852276b08 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.157475 May 18 22:50:36.700710 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 439/874] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:36 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:37.716791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:37.717430 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:37.724058 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:37.724500 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:37.725250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:37.725696 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:37.859062 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:37.866573 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-80dfd764-929f-4496-acc1-02847599278b tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.153836 May 18 22:50:37.867142 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 436/875] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:37 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:38.884407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:38.884999 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:38.892094 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:38.892533 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:38.893278 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:38.893709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:39.028723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:39.036941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d38d3947-b3a2-4dee-a622-71223618acbb tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.156749 May 18 22:50:39.037530 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 440/876] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:38 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:39.207671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-2f2dffec-5603-4687-bc39-f7826ba10924 req-829a3705-916b-4301-a514-5ae255dc6083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "name": "network-vif-plugged", "status": "completed", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:50:39.216411 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2f2dffec-5603-4687-bc39-f7826ba10924 req-829a3705-916b-4301-a514-5ae255dc6083 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:39.216842 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2f2dffec-5603-4687-bc39-f7826ba10924 req-829a3705-916b-4301-a514-5ae255dc6083 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:39.227770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-2f2dffec-5603-4687-bc39-f7826ba10924 req-829a3705-916b-4301-a514-5ae255dc6083 service nova] Creating event network-vif-plugged:60d9c274-368f-4afe-81d6-9735f604892c for instance c850c82e-2876-4797-8a76-d09960544a2f on hv-cinder-83800 May 18 22:50:39.233304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-2f2dffec-5603-4687-bc39-f7826ba10924 req-829a3705-916b-4301-a514-5ae255dc6083 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029295 May 18 22:50:39.236743 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 437/877] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:50:40.054307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:40.054918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:40.062456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:40.062903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:40.063716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:40.064151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:40.203679 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:40.211227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cc3d31b8-2056-45b2-9243-b8d4d37a9290 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.160755 May 18 22:50:40.211787 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 441/878] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:40 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:41.229285 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:41.229981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:41.236301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:41.236747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:41.237510 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:41.237947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:41.372222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:41.379727 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-826cbb41-ae37-42c8-8a35-60b3f42b57e9 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1572 microversion: 2.1 time: 0.155142 May 18 22:50:41.380300 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 438/879] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:41 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:50:42.396678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:50:42.397341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:50:42.404451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:42.404892 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:42.405649 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:50:42.406110 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:50:42.540099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:50:42.548303 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-abf552d2-7da5-4945-8b48-742ae4b34856 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1559 microversion: 2.1 time: 0.155517 May 18 22:50:42.548847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 442/880] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:50:42 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:19.036853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:19.037829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:19.039795 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=15 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:19.040466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:19.045234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:19.045955 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:19.046756 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:19.047214 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:19.072242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c7e124c4-1fa9-47ac-b7be-860546c3411a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/ips" status: 200 len: 152 microversion: 2.20 time: 0.039758 May 18 22:51:19.072811 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 439/881] 10.222.0.70 () {60 vars in 1288 bytes} [Wed May 18 22:51:19 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:51:22.165082 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:51:22.165629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:22.167642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=7 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:22.168444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=99 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:22.173298 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:22.174508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:22.175534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:22.175981 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:22.198342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lazy-loading 'flavor' on Instance uuid 64e6d587-6645-4e55-9b94-9ca2c2d08ffa {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:51:22.644528 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2ab89c71-71f4-4b35-9bf0-d876e28568d9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/action" status: 202 len: 0 microversion: 2.20 time: 0.483197 May 18 22:51:22.645053 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 443/882] 10.222.0.70 () {62 vars in 1318 bytes} [Wed May 18 22:51:22 2022] POST /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 18 22:51:22.653763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:22.654421 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:22.662312 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:22.662760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:22.663531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:22.663963 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:22.793190 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:22.801363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:22.802889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:22.804037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-968acfa4-e410-4668-9818-26bf51f057d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.154872 May 18 22:51:22.804593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 440/883] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:22 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:23.824358 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:23.825079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:23.832108 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:23.832551 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:23.833300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:23.833730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:23.964200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:23.972300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:23.973785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:23.974951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-13d8ba32-24cc-4113-bee1-8f9f1250c43d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.155622 May 18 22:51:23.975515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 444/884] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:23 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:24.993309 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:24.993921 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:25.000465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:25.000916 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:25.001677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:25.002740 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:25.131333 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:25.139136 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:25.140641 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:25.141799 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3d566839-5b6d-4110-b3f4-c8d55382e6b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.152431 May 18 22:51:25.142400 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 441/885] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:24 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:26.160871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:26.161472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:26.167893 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:26.168333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:26.169081 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:26.169507 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:26.298222 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:26.306736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:26.308231 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:26.309381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-39e8ce03-31e6-44f6-8b2b-58eee8280732 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.153183 May 18 22:51:26.310034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 445/886] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:26 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:27.327653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:27.328195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:27.334736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:27.335186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:27.335944 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:27.336380 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:27.466746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:27.475523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:27.477096 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:27.478278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b8f65e78-88d2-432e-bcd2-d25286569bc2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.154592 May 18 22:51:27.478843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 442/887] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:27 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:28.496873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:28.497480 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:28.504861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:28.505308 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:28.506104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:28.506545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:28.633669 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:28.641537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:28.643354 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:28.644493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-baad6b53-fd63-4afe-a2fc-23cfb7c9b21c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.151526 May 18 22:51:28.645057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 446/888] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:28 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:29.663432 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:29.664037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:29.670101 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:29.670783 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:29.671535 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:29.671962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:29.805552 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:29.813664 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:29.815690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:29.816839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b0ec22a0-31c2-492e-b587-4be0eb529328 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.157579 May 18 22:51:29.817436 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 443/889] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:29 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:30.834865 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:30.835409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:30.841764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:30.842238 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:30.842995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:30.843425 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:30.969666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:30.970267 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:30.976573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:30.976970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:30.977419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:30.978213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:30.978817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:30.984823 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:30.986942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:30.988155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a1d43537-c543-45a3-80fe-c235aa5c1a49 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.157309 May 18 22:51:30.988794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 447/890] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:30 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:31.003017 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-63feb426-a152-44c8-97da-f05249851228 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/ips" status: 200 len: 146 microversion: 2.1 time: 0.044722 May 18 22:51:31.003619 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 444/891] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:51:30 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:51:32.006946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:32.007406 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:32.013430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:32.014028 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:32.019254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:32.019254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:32.145496 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:32.153589 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:32.155114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:32.156248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e4a0878b-787b-4b1b-8087-736dfce0efcd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.153334 May 18 22:51:32.156864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 448/892] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:32 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:33.175102 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:33.175710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:33.182248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:33.182682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:33.183444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:33.183883 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:33.317032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:33.324872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:33.326478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:33.327623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0aaa9ba2-b0e4-403b-ade1-d0eb48b8c799 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.157299 May 18 22:51:33.328171 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 445/893] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:33 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:34.345882 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:34.346581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:34.353167 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:34.353614 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:34.354395 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:34.354827 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:34.487197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:34.495408 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:34.497068 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:34.498258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7efd469f-c915-44da-acb6-170fdb251f1a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.156726 May 18 22:51:34.498817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 449/894] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:34 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:35.516851 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:35.518129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:35.524854 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:35.525324 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:35.526146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:35.526589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:35.664595 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:35.672794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:35.675012 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:35.676113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-bddd03cf-864c-4434-851a-8b4e0b6e91e6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.163269 May 18 22:51:35.676677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 446/895] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:35 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:36.421185 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864f9519-49db-4887-a7b5-cfacfd11e098"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:51:36.422226 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:36.428941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:36.429800 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:36.430246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:36.430686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:36.695348 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:36.695911 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:36.703347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:36.703347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:36.703582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:36.703875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:36.840850 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:36.845907 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:36.848048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:36.849201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2ed7c6c6-bc48-4f33-8920-594b42c15bb9 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.157752 May 18 22:51:36.849769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 447/896] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:36 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:51:37.293843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6fed4b7c-bbd8-48ab-8ce2-c5499f59ccd2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876921 May 18 22:51:37.294617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 450/897] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:51:36 2022] POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:51:37.867446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:37.868000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:37.874236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:37.874685 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:37.875447 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:37.875886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:38.088498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:38.096587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:38.098126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:38.099293 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4bf76914-020e-43ab-9ff2-2260ea7d3ebf tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.235845 May 18 22:51:38.099850 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 448/898] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:37 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:39.118916 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:39.119615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:39.125917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:39.127687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:39.127687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:39.128173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:39.258918 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:39.266794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:39.268791 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:39.269929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0abcb9d4-dcf9-4aff-a097-51b3488a196b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.155894 May 18 22:51:39.270822 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 451/899] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:39 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:40.288383 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:40.288942 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:40.295769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:40.296219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:40.296981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:40.297786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:40.430103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:40.438063 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:40.445870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:40.445870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-bcc87b71-8a02-4107-9d4b-229bcf1f6bd1 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.157086 May 18 22:51:40.445870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 449/900] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:40 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:41.458667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:41.459272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:41.465764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:41.466251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:41.467022 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:41.467456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:41.610298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-aae06ea7-5d75-4fbf-a062-da8a4aa0f3e9 req-3c7d3708-33c1-4dd7-8783-190299284678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "name": "network-vif-plugged", "status": "completed", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:51:41.613236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:41.620810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-aae06ea7-5d75-4fbf-a062-da8a4aa0f3e9 req-3c7d3708-33c1-4dd7-8783-190299284678 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:41.621247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-aae06ea7-5d75-4fbf-a062-da8a4aa0f3e9 req-3c7d3708-33c1-4dd7-8783-190299284678 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:41.623494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:41.624984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:41.626158 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-81e482b7-3361-44d6-b208-e1d6dd5de2ae tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.171400 May 18 22:51:41.626717 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 452/901] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:41 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:41.633174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-aae06ea7-5d75-4fbf-a062-da8a4aa0f3e9 req-3c7d3708-33c1-4dd7-8783-190299284678 service nova] Creating event network-vif-plugged:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:51:41.638778 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-aae06ea7-5d75-4fbf-a062-da8a4aa0f3e9 req-3c7d3708-33c1-4dd7-8783-190299284678 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033944 May 18 22:51:41.639579 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 450/902] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:51:42.645563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:42.646215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:42.652701 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:42.653160 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:42.653974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:42.654391 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:42.781075 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:42.789014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:42.790542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:42.791681 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5d3cc3bf-852b-453a-b334-6a8899efb3cd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.151123 May 18 22:51:42.792242 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 453/903] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:42 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:43.810979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:43.811639 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:43.818769 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:43.819220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:43.820307 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:43.820747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:43.957042 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:43.966097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:43.967593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:43.968757 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-72e07c7b-e7f4-4bf5-93bf-68295f3910b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.162118 May 18 22:51:43.969313 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 451/904] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:43 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:44.644066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-215387177", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-923270520", "security_groups": [{"name": "tempest-secgroup-smoke-552150152"}], "block_device_mapping_v2": [{"uuid": "091ebe6e-f5d2-4002-b11c-85be31c44701", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cb762368-0a84-43af-8013-3ba314096c24"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:51:44.754442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] validate_networks() for [('cb762368-0a84-43af-8013-3ba314096c24', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:51:44.986707 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:44.987670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:44.994277 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:44.994966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:44.995741 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:44.996191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:45.191219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:45.199135 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:45.200631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:45.201787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-567ddf16-5990-4fb9-b7dc-f2faee40ec2c tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1743 microversion: 2.20 time: 0.219145 May 18 22:51:45.202380 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 452/905] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:44 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:45.205301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:51:45.206277 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:51:45.206755 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:51:45.207163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:51:45.207572 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:51:45.216243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:45.216685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:45.217478 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:45.217910 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:45.234699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:51:45.239458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Getting quotas for user 298370ea294c4150be7de29116e49d73 and project 7994cefc64b44d1e92e94a9c8c1cca31. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:51:45.294769 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:51:45.297100 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='091ebe6e-f5d2-4002-b11c-85be31c44701',volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:51:45.703435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-36c7626f-d833-47ed-bac7-878b79e72310 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.063754 May 18 22:51:45.704153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 454/906] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:51:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:51:45.714271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6c49f231-bce6-4f2e-ac25-2a84beb4c696 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:45.714882 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6c49f231-bce6-4f2e-ac25-2a84beb4c696 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:45.780104 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6c49f231-bce6-4f2e-ac25-2a84beb4c696 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:45.789314 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6c49f231-bce6-4f2e-ac25-2a84beb4c696 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1093 microversion: 2.1 time: 0.079041 May 18 22:51:45.790438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 453/907] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:45 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:46.221215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:46.221833 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:46.230095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:46.230560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:46.231691 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:46.232305 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:46.371298 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:46.379251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:46.380715 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:46.381859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8c8b6d3d-b97f-4d2f-a503-89d425988874 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.165843 May 18 22:51:46.382696 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 455/908] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:46 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:46.817479 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:46.829507 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:46.835055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:46.835055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:46.835528 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:46.836271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:46.916304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:46.924328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-649220d8-20d3-4d4d-9ce0-9b42762320f4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1143 microversion: 2.1 time: 0.117439 May 18 22:51:46.925023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 454/909] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:46 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1143 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:47.403585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:47.404539 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:47.412291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:47.412879 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:47.413771 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:47.414363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:47.559327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:47.563393 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:47.568645 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:47.574354 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:47.574354 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a33415a9-c101-4924-8760-caf1c864c4d2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.171713 May 18 22:51:47.574354 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 456/910] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:47 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:47.942556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:47.944027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:47.956500 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:47.961319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:47.964810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:47.966949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:48.090308 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:48.097191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-416b0af1-a104-4eda-abb8-d67fab7047b7 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1209 microversion: 2.1 time: 0.159746 May 18 22:51:48.098847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 455/911] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:47 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1209 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:48.590126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:48.590796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:48.598666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:48.599371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:48.600146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:48.600584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:48.842647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:48.854366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:48.858227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:48.858227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-083e8b37-8292-4d3a-9dc4-03db3d64ba94 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.271143 May 18 22:51:48.858227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 457/912] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:48 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:49.117194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:49.117853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:49.124460 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:49.125118 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:49.126072 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:49.126512 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:49.660676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:49.672296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f1ac03fc-acd5-4fab-9b8d-4e80e542876f tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1276 microversion: 2.1 time: 0.560502 May 18 22:51:49.679034 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 456/913] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:49 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1276 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:49.875739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:49.876340 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:49.883667 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:49.884113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:49.884894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:49.885334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:50.109341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:50.134690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:50.146252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:50.149804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b68882b2-97bc-40d6-b4f4-2e5348ee26a2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.276766 May 18 22:51:50.162201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 458/914] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:49 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:50.322531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-6f762e2f-7a44-44fe-ba38-e71286818bb7 req-8d369405-f853-4016-909f-bc2cfe588499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe", "tag": "61069edb-146b-4923-938f-0e918446b79b"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:51:50.332648 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-6f762e2f-7a44-44fe-ba38-e71286818bb7 req-8d369405-f853-4016-909f-bc2cfe588499 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:50.333394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-6f762e2f-7a44-44fe-ba38-e71286818bb7 req-8d369405-f853-4016-909f-bc2cfe588499 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:50.356483 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-6f762e2f-7a44-44fe-ba38-e71286818bb7 req-8d369405-f853-4016-909f-bc2cfe588499 service nova] Creating event network-changed:61069edb-146b-4923-938f-0e918446b79b for instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe on hv-cinder-83800 May 18 22:51:50.361471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-6f762e2f-7a44-44fe-ba38-e71286818bb7 req-8d369405-f853-4016-909f-bc2cfe588499 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042522 May 18 22:51:50.362109 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 457/915] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:51:50.787718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:50.787718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:50.787718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:50.787718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:50.788237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:50.788237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:50.935502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:50.946370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3abbd1f1-d9be-4811-b575-102f6e1078fd tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1276 microversion: 2.1 time: 0.253156 May 18 22:51:50.954675 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 459/916] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:50 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1276 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:51:51.178249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:51.181174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:51.189618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.190509 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:51.192293 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.193137 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:51.232516 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:51.385597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-51c85e8c-a464-4c90-9858-f1f73ef937c8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:51:51.393116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51c85e8c-a464-4c90-9858-f1f73ef937c8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.393559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-51c85e8c-a464-4c90-9858-f1f73ef937c8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:51.457218 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:51.458030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-51c85e8c-a464-4c90-9858-f1f73ef937c8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Going to try to stop instance {{(pid=124367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 18 22:51:51.466651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:51.468723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:51.470113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-70785920-ec4e-4c3e-a657-9a4f9b5ce692 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.297481 May 18 22:51:51.482116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 458/917] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:51 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:51.625136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-51c85e8c-a464-4c90-9858-f1f73ef937c8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action" status: 202 len: 0 microversion: 2.1 time: 0.248806 May 18 22:51:51.625808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 460/918] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:51:51 2022] POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 22:51:51.639541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:51.640328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:51.647392 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.647849 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:51.648687 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.649141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:51.791934 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:51.805699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-02a31ae1-97db-42fe-acca-bba7f0f22aa3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.170146 May 18 22:51:51.806653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 459/919] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:51 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:51.962957 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:51.963558 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:51.970467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.970925 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:51.971699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:51.972776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:52.167702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:52.167702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aa30c06a-b4d0-4558-9ddf-bcea37646b60 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1276 microversion: 2.1 time: 0.177375 May 18 22:51:52.167702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 461/920] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:51 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:52.491626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:52.492721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:52.499875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:52.500957 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:52.502361 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:52.502958 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:52.657337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:52.666126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:52.667518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:52.668670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cf215d06-5965-4040-b496-ac2b9b5e1560 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.183166 May 18 22:51:52.669419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 460/921] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:52 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:52.823873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:52.825176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:52.828701 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:52.833648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:52.835617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:52.835617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:52.836186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:52.980566 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:52.989037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-504cdca2-1620-4309-a976-5afd25d376c2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.169106 May 18 22:51:52.989595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 462/922] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:52 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:53.163235 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:53.163852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:53.166033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=47 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:53.171141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:53.171772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:53.172547 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:53.172986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:53.386328 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:53.395204 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-94135adf-ea05-4610-bb67-08ce69d1c37d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.236327 May 18 22:51:53.396413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 461/923] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:53 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:53.687433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:53.688327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:53.694840 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:53.695979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:53.696106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:53.696549 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:53.835069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:53.844061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:53.845719 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:53.847825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7ac01e67-9b1a-4998-8542-daad11a0ea87 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.163471 May 18 22:51:53.850855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 463/924] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:53 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:54.006600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:54.007356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:54.014322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:54.014777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:54.015560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:54.015999 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:54.162401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:54.170659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-56b207af-cd19-402a-85e7-e87eda67604e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.168057 May 18 22:51:54.171223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 462/925] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:54 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:54.414245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:54.424508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:54.424508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:54.424508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:54.424508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:54.424920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:54.616644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:54.624294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6572eb90-d115-4f1d-867e-4a28f222a5fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.214330 May 18 22:51:54.624902 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 464/926] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:54 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:54.865377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:54.865888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:54.872498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:54.872940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:54.873700 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:54.874153 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:55.011239 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:55.020998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:55.022503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:55.023651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2806d16e-c28e-450b-bca9-eb4da9000306 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.162894 May 18 22:51:55.024203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 463/927] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:54 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:55.190199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:55.190834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:55.197656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:55.198414 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:55.199298 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:55.199867 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:55.232542 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:55.246367 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:55.337869 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:55.345938 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c23aa17c-8d07-49b0-a3f5-51cffbdb17e8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.161309 May 18 22:51:55.346557 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 465/928] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:55 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:55.644342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:55.644978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:55.651912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:55.652357 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:55.653181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:55.653654 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:55.785629 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:51:55.793195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:55.801358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9e27e33e-1d33-4f28-aff9-2421cd795488 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.162776 May 18 22:51:55.801933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 464/929] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:55 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:56.042437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:56.043051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:56.049887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:56.050369 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:56.051141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:56.051583 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:56.200974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:56.212323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:56.213860 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:56.215093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d6ee568e-20d2-4f37-8100-475a69dda8fb tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.176595 May 18 22:51:56.215864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 466/930] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:56 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:56.363583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:56.364855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:56.372503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:56.372958 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:56.373766 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:56.374243 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:56.532657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:56.538494 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-714cc3e8-3db6-4463-ada6-2a5eac3ffe6c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.179263 May 18 22:51:56.539477 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 465/931] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:56 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:56.822104 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:56.822653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:56.828774 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:56.829220 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:56.829983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:56.830441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:56.996751 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:57.006125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f21eb94e-c123-4be0-a173-3ce307f0ca06 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.187355 May 18 22:51:57.020374 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 467/932] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:56 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:57.235675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:57.236397 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:57.244078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:57.244618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:57.245452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:57.245978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:57.382438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:57.390238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:57.391714 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:57.392863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a552cfee-fa1b-40e4-b753-09b74a03a39b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.161186 May 18 22:51:57.393419 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 466/933] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:57 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:57.557519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:57.558234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:57.565142 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:57.565993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:57.574146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:57.574146 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:57.744158 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:57.753584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b00de42e-7867-4f98-a1e9-e1f12cab7ca4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.200598 May 18 22:51:57.754334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 468/934] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:57 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:58.027311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:58.027919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:58.034131 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:58.034582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:58.035353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:58.035880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:58.186424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:58.195471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-605046fa-5265-490a-b425-13a7887c4f0d tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.172086 May 18 22:51:58.196160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 467/935] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:58 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:58.411703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:58.412887 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:58.419359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:58.419802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:58.420838 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:58.421272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:58.563255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:58.571987 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:58.573534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:58.574985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-56f3b637-40a6-46fc-be07-4507fcb2acc7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.167257 May 18 22:51:58.575698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 469/936] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:58 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:51:58.772376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:58.774098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:58.780801 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:58.781286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:58.782157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:58.782783 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:58.930400 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:58.939406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd315f34-6465-4754-b715-347144e80435 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.171033 May 18 22:51:58.940000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 468/937] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:58 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:59.214518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:59.215573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:59.224045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:59.225554 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:59.227013 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:59.227746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:59.389231 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:59.399082 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3abdc2b8-c633-49f2-9e86-bdb165461e92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.189492 May 18 22:51:59.409701 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 470/938] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:59 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:51:59.594179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:59.594721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:59.601272 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:59.601708 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:59.602498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:59.602927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:59.763894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:59.773527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:59.775106 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:51:59.776281 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c6657e22-a7a8-420f-b2af-4d790beb6d48 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.186754 May 18 22:51:59.776847 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 469/939] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:51:59 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:51:59.956658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:51:59.957262 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:51:59.977212 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:59.977662 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:51:59.978467 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:51:59.978911 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:00.134333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:00.142443 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8c8f9d0f-ee6c-42ff-9f2e-3c1d2da51ac4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.189605 May 18 22:52:00.143032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 471/940] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:51:59 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:00.418738 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:00.421682 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:00.431725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:00.432334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:00.433125 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:00.433560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:00.581177 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:00.589263 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2945646f-4cde-48b6-821c-c7f0309c4513 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.175944 May 18 22:52:00.598548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 470/941] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:00 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:00.795273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:00.796529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:00.803330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:00.803772 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:00.804540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:00.804998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:00.823174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:00.953176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:00.962610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:00.964118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:00.965275 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cbdacac2-1bde-4a89-9782-56ab34f04d69 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.174252 May 18 22:52:00.965839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 472/942] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:00 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:01.159115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:01.159831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:01.167014 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:01.167534 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:01.168367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:01.168884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:01.301544 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:01.309522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-73cb308b-114f-4713-b631-81b13190e33a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.154257 May 18 22:52:01.310092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 471/943] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:01 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:01.606898 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:01.607406 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:01.613841 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:01.614327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:01.615111 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:01.616107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:01.748732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:01.756399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-92ce3162-c3b1-41cb-982a-96a71e660b94 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.153828 May 18 22:52:01.757177 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 473/944] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:01 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:01.987664 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:01.988273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:01.994351 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:01.994802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:01.995561 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:01.995995 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:02.128501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:02.137536 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:02.139022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:02.140179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1af26c2a-d412-49f4-8b2a-05770ce4e23f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1738 microversion: 2.20 time: 0.156451 May 18 22:52:02.140746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 472/945] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:01 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:02.327513 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:02.328128 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:02.335160 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:02.335607 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:02.336382 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:02.336826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:02.470933 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:02.479334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-37240dd3-159a-4087-890d-82ed554bb0fe tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1724 microversion: 2.1 time: 0.155909 May 18 22:52:02.480092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 474/946] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:02 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:02.772816 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:02.773455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:02.779878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:02.781935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:02.781935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:02.781935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:02.956330 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:02.963957 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dbee5d1d-cc00-4cd5-bcb8-1ee40e524e49 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.195189 May 18 22:52:02.964527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 473/947] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:02 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:52:03.159373 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:03.159980 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:03.166770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.167227 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.167970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.168399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.296555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:03.304985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:03.306541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:03.307687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d79892b3-3bca-4d68-bcdd-377721c10778 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1720 microversion: 2.20 time: 0.152311 May 18 22:52:03.308251 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 475/948] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:03 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:03.497317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:03.497919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:03.504021 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.504468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.505257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.505691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.631198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:03.639172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2fe08279-fd0f-4555-8a95-1703d55a1310 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1701 microversion: 2.1 time: 0.145704 May 18 22:52:03.639752 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 474/949] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:03 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1701 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:03.663248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-94b39c0a-4fb3-40a7-af7a-e6cd3f3bdcdb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:03.671874 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-94b39c0a-4fb3-40a7-af7a-e6cd3f3bdcdb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.672322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-94b39c0a-4fb3-40a7-af7a-e6cd3f3bdcdb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.694848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-94b39c0a-4fb3-40a7-af7a-e6cd3f3bdcdb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Going to try to start instance {{(pid=124367) start /opt/stack/nova/nova/compute/api.py:2730}} May 18 22:52:03.831997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-94b39c0a-4fb3-40a7-af7a-e6cd3f3bdcdb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action" status: 202 len: 0 microversion: 2.1 time: 0.171607 May 18 22:52:03.831997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 476/950] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:52:03 2022] POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:52:03.833162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-2c2a71ab-349a-4134-8d5c-bf7606fb8d86 req-c85e7052-c1ce-4f7d-83f3-6b69b4319fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe", "name": "network-vif-plugged", "status": "completed", "tag": "61069edb-146b-4923-938f-0e918446b79b"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:03.839818 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:03.840527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:03.843089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2c2a71ab-349a-4134-8d5c-bf7606fb8d86 req-c85e7052-c1ce-4f7d-83f3-6b69b4319fc1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.843532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2c2a71ab-349a-4134-8d5c-bf7606fb8d86 req-c85e7052-c1ce-4f7d-83f3-6b69b4319fc1 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.846720 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.847174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.847444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=100 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:03.848055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.848501 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.855037 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-2c2a71ab-349a-4134-8d5c-bf7606fb8d86 req-c85e7052-c1ce-4f7d-83f3-6b69b4319fc1 service nova] Creating event network-vif-plugged:61069edb-146b-4923-938f-0e918446b79b for instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe on hv-cinder-83800 May 18 22:52:03.860130 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-2c2a71ab-349a-4134-8d5c-bf7606fb8d86 req-c85e7052-c1ce-4f7d-83f3-6b69b4319fc1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032833 May 18 22:52:03.860736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 475/951] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:52:03.982549 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:03.983327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:03.989070 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:03.990060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.990729 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.991514 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:03.991954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:03.997359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2e4ad371-3d14-4c6b-b769-746ae2b43942 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1710 microversion: 2.1 time: 0.161935 May 18 22:52:03.997942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 477/952] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:03 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:52:04.124756 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:04.132282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f71ce185-51d1-439d-b050-24f96639e2fa tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.154401 May 18 22:52:04.132863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 476/953] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:03 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:04.325776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:04.326431 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:04.332338 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:04.332778 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:04.333521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:04.333952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:04.465610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:04.473435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:04.475569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:04.476800 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7dadb204-01aa-47f7-9afd-78cf92021633 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1720 microversion: 2.20 time: 0.154873 May 18 22:52:04.477359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 478/954] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:04 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:05.014248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:05.014855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:05.022242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.023144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.024302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.024754 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.150390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:05.151864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:05.161471 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.163491 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.164523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.165434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.202760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:05.212640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a5d40440-1427-411f-a33f-aed84b8cd0bb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1710 microversion: 2.1 time: 0.202229 May 18 22:52:05.213657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 477/955] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:05 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1710 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:05.313659 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:05.322138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5934cd29-f56a-44d3-ad7d-6d7b2c188cd5 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.177267 May 18 22:52:05.322735 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 479/956] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:05 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:05.495329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:05.495930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:05.501820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.502302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.503085 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.503518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.635060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:05.643042 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:05.644584 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:05.645899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-08cc45e6-dad0-49cd-ae5b-429fe29192b3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1723 microversion: 2.20 time: 0.154424 May 18 22:52:05.646633 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 478/957] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:05 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:05.664066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "485284af-006f-4bf3-9897-387081c77f06"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:05.665206 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:05.671582 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.672039 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.672812 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.673252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.877725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-a1bcdc89-4132-4373-8bcd-dc67892e5dc8 req-515c9a15-ace6-46b2-b192-3de2bd17ab4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "name": "network-vif-unplugged", "status": "completed", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:05.886444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a1bcdc89-4132-4373-8bcd-dc67892e5dc8 req-515c9a15-ace6-46b2-b192-3de2bd17ab4e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:05.886884 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a1bcdc89-4132-4373-8bcd-dc67892e5dc8 req-515c9a15-ace6-46b2-b192-3de2bd17ab4e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:05.898379 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-a1bcdc89-4132-4373-8bcd-dc67892e5dc8 req-515c9a15-ace6-46b2-b192-3de2bd17ab4e service nova] Creating event network-vif-unplugged:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:52:05.903106 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-a1bcdc89-4132-4373-8bcd-dc67892e5dc8 req-515c9a15-ace6-46b2-b192-3de2bd17ab4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029113 May 18 22:52:05.903679 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 479/958] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:52:06.231298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:06.232007 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:06.238803 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:06.239259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:06.240024 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:06.241026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:06.374531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:06.382591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-912d695b-40a0-4f55-b137-d4fa7746fb75 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1710 microversion: 2.1 time: 0.155433 May 18 22:52:06.383150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 480/959] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:06 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:52:06.387506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:06.388099 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:06.393718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:06.396185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:06.396185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:06.396185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:06.527039 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:06.534658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4188e002-26ca-4e30-9c39-aa44a0b84553 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1264 microversion: 2.1 time: 0.150541 May 18 22:52:06.535232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 481/960] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:06 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:06.649437 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-33d4e4ef-acc2-4b7c-8a73-366302326238 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.989919 May 18 22:52:06.650089 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 480/961] 10.222.0.70 () {62 vars in 1363 bytes} [Wed May 18 22:52:05 2022] POST /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-volume_attachments => generated 188 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 22:52:06.775457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:06.775952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:06.782388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:06.782838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:06.783660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:06.784101 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.399620 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:07.400225 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:07.407517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.407927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.408691 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.409125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.460752 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8cee060c-d594-48f8-9df0-aa267fa439b7 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-volume_attachments/485284af-006f-4bf3-9897-387081c77f06" status: 202 len: 0 microversion: 2.20 time: 0.690171 May 18 22:52:07.464279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 482/962] 10.222.0.70 () {60 vars in 1456 bytes} [Wed May 18 22:52:06 2022] DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-volume_attachments/485284af-006f-4bf3-9897-387081c77f06 => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 18 22:52:07.518215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:07.518781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:07.526095 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.526494 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.527262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.527699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.548863 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:07.556842 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-183a61b3-f6b2-47c3-a4b7-dc5cb4cce44b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1710 microversion: 2.1 time: 0.161702 May 18 22:52:07.557422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 481/963] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:07 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:52:07.561764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:07.562587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:07.568616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.569186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.579161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.579161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.700920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:07.708460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-db647670-b909-4aa1-a315-686c6d2d4130 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1451 microversion: 2.1 time: 0.150107 May 18 22:52:07.709560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 482/964] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:07 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:07.732871 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:07.733473 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:07.739342 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.739795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.741189 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.741639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.754986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7a142432-3052-4b68-8374-adda48eaa96e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "POST /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/action" status: 202 len: 0 microversion: 2.20 time: 0.240615 May 18 22:52:07.757165 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 483/965] 10.222.0.70 () {62 vars in 1318 bytes} [Wed May 18 22:52:07 2022] POST /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 18 22:52:07.764367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:07.765142 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:07.772207 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.772660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.773586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:07.774041 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:07.935720 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:07.943964 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-67e2a810-f9bc-40f4-9e3f-57a85d8242d4 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1451 microversion: 2.1 time: 0.214642 May 18 22:52:07.944541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 483/966] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:07 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1451 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:52:07.958470 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:07.969386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:07.970967 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:07.972129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8e668bc9-fe92-4569-adcb-837e33e1533b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1671 microversion: 2.20 time: 0.211710 May 18 22:52:07.973000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 484/967] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:07 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1671 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:08.573968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:08.574608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:08.581064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:08.581510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:08.582287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:08.582718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:08.721513 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:08.730448 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-44f1c5d7-f4de-4ed7-a943-c6177d75c54f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1710 microversion: 2.1 time: 0.160345 May 18 22:52:08.731009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 484/968] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:08 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:52:08.991427 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:08.992197 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:08.998741 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:08.999190 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:08.999968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:09.000400 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:09.144076 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:09.154825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:09.156600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:09.157853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6ac93b42-be2a-441b-9ba8-7aadb932deee tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1673 microversion: 2.20 time: 0.170955 May 18 22:52:09.158695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 485/969] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:08 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:09.747532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:09.748139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:09.755154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:09.755608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:09.756534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:09.756968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:09.776724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:09.895755 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:09.904736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e0e2eebf-1aaf-422f-ab08-6e4c2880e21a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1714 microversion: 2.1 time: 0.161150 May 18 22:52:09.905850 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 485/970] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:09 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1714 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:10.177323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:10.179878 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:10.186477 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:10.186923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:10.187880 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:10.188315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:10.252524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-abc7d42f-b084-4ff3-ba9e-74f6d3308cdd req-75b94b20-64b4-4daa-9104-5f0da33e4df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe", "tag": "61069edb-146b-4923-938f-0e918446b79b"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:10.268666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-abc7d42f-b084-4ff3-ba9e-74f6d3308cdd req-75b94b20-64b4-4daa-9104-5f0da33e4df4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:10.269568 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-abc7d42f-b084-4ff3-ba9e-74f6d3308cdd req-75b94b20-64b4-4daa-9104-5f0da33e4df4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:10.288180 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-abc7d42f-b084-4ff3-ba9e-74f6d3308cdd req-75b94b20-64b4-4daa-9104-5f0da33e4df4 service nova] Creating event network-changed:61069edb-146b-4923-938f-0e918446b79b for instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe on hv-cinder-83800 May 18 22:52:10.295851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-abc7d42f-b084-4ff3-ba9e-74f6d3308cdd req-75b94b20-64b4-4daa-9104-5f0da33e4df4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046697 May 18 22:52:10.297847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 486/971] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:10.342949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:10.351681 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:10.353185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:10.354382 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4527e927-25c7-4e49-ae81-64585f3c0b25 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.180913 May 18 22:52:10.355151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 486/972] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:10 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:10.496050 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:52:10.496307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 22:52:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 22:52:11.374690 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:11.375766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:11.384526 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:11.384973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:11.385891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:11.386355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:11.546320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:11.551236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:11.552873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:11.554090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-933d375d-983d-4b39-aecf-3a56f00389d0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.184541 May 18 22:52:11.554642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 487/973] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:11 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:12.575088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:12.575641 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:12.582557 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:12.583011 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:12.584564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:12.585337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:12.715856 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:12.723790 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:12.726143 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:12.727296 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7e083a13-7649-4b3d-8641-325a424f26d6 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.156226 May 18 22:52:12.728101 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 487/974] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:12 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:13.745980 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:13.746597 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:13.753193 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:13.753666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:13.754465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:13.754900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:14.140252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:14.150267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:14.151868 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:14.153270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6e4f66e7-4c90-4c41-89bd-98eeb90abb66 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.410997 May 18 22:52:14.157474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 488/975] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:13 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:15.172291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:15.172899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:15.180247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:15.180694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:15.181463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:15.181896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:15.321935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:15.330329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:15.331835 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:15.332998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a56b4dde-9379-4a37-9f45-95d13880175e tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.164861 May 18 22:52:15.333565 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 488/976] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:15 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:16.352316 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:16.352988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:16.366552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:16.367036 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:16.367813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:16.368257 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:16.533065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:16.542181 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:16.543728 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:16.545141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9c691f30-04a3-47dc-a5c5-266310d6f43b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.197884 May 18 22:52:16.545702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 489/977] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:16 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:17.563888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:17.564520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:17.572055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:17.572503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:17.573291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:17.573723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:17.706145 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:17.708438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:17.720350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:17.779905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:17.779905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-85df15e0-2e6f-4527-a98e-af9f265f1c65 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.163240 May 18 22:52:17.779905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 489/978] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:17 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:18.050611 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:18.051151 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:18.057819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:18.058304 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:18.059369 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:18.060032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:18.084934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-522259ee-c1a6-490e-a5ba-e7157f337611 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/ips" status: 200 len: 148 microversion: 2.1 time: 0.038174 May 18 22:52:18.088344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 490/979] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:52:18 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:18.743245 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:18.743840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:18.750835 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:18.751515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:18.752301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:18.752743 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:18.902519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:18.910943 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:18.912651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:18.914593 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-57d4339c-6fe6-4c91-8111-39ae515cfbb5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.175092 May 18 22:52:18.917717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 490/980] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:18 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:19.933014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:19.933644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:19.940159 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:19.941617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:19.941617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:19.941984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:20.073929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:20.081880 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:20.083416 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:20.084538 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b284f4e6-5da2-4f0c-9cae-3597e04579de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.155747 May 18 22:52:20.085088 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 491/981] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:19 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:20.687919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426e53fd-795e-4a49-8566-8e7b4c00722f"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:20.689038 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:20.696074 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:20.696513 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:20.697261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:20.697690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:21.103364 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:21.104133 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:21.110994 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:21.111435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:21.112200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:21.112805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:21.247502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:21.255401 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:21.256914 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:21.258430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9a27c67d-3cdf-4230-9de4-123cf093bc26 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.159041 May 18 22:52:21.258991 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 492/982] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:21 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:22.276254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:22.277860 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:22.285057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:22.285517 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:22.286339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:22.286747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:22.417698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:22.425814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:22.427335 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:22.428474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cc4326c9-598a-4850-8410-4bca7a07ad1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.156480 May 18 22:52:22.429085 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 493/983] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:22 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:23.446777 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:23.447625 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:23.449248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=64 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:23.454218 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:23.454658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:23.455415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:23.455844 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:23.611759 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:23.620647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:23.622314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:23.623449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-40be028f-cb9a-4bd5-bebe-e0dffe87e2a0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.180892 May 18 22:52:23.624255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 494/984] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:23 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:24.642493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:24.643571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:24.651126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:24.651571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:24.652327 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:24.652758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:24.787171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:24.795534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:24.796972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:24.798127 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0605aa98-a534-4b54-964b-ed830c557a8f tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.159801 May 18 22:52:24.798675 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 495/985] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:24 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:25.815999 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:25.816686 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:25.823499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:25.823950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:25.824717 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:25.825152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:25.953498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:25.961444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:25.962956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:25.964095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-06a72629-21cc-404d-8b65-0d588ef4afd3 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.151990 May 18 22:52:25.964656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 496/986] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:25 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:26.983060 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:26.983743 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:26.990352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:26.990804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:26.991589 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:26.992026 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:27.126099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:27.134703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:27.139581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:27.139581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0beb8d04-cc64-489b-bcf8-3fa266ba18ff tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.158144 May 18 22:52:27.139581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 497/987] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:26 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:28.155478 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:28.156092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:28.162861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:28.163907 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:28.164711 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:28.165141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:28.290933 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:28.299185 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:28.300671 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:28.301798 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-63fe2320-dc1d-48e8-a2a5-89b866223338 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.150238 May 18 22:52:28.302383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 498/988] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:28 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:29.321438 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:29.322101 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:29.328465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:29.328919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:29.329682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:29.330143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:29.458028 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:29.466154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:29.467764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:29.468891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4bf8ce52-caf8-43e5-9e2c-9750601b9504 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.152341 May 18 22:52:29.469458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 499/989] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:29 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:30.093322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1d8ca1b7-cd7a-427b-8519-1c0f62af4544 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "POST /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.409233 May 18 22:52:30.096893 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 491/990] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:52:20 2022] POST /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments => generated 194 bytes in 9411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:30.487687 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:30.488270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:30.495318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:30.495760 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:30.496515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:30.496946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:30.780290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:30.788113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:30.790235 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:30.791361 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c067e307-f37b-42a1-a90e-c9a425229d4a tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.307584 May 18 22:52:30.791923 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 500/991] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:30 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:31.807614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=63 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:31.812154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:31.812927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:31.819172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:31.820157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:31.820909 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:31.821567 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:31.958029 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:31.966781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:31.970385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:31.970385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7b9658a5-4dcc-46cd-8402-0f16a1f5bcf2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.163535 May 18 22:52:31.970385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 492/992] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:31 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:32.078820 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:32.079941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:32.081473 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-e05986f1-ed03-48e8-b9d3-7472b6823ed3 req-d380e938-8cea-4457-9611-0d59bc860305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:32.087504 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.088243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:32.089221 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.089725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-e05986f1-ed03-48e8-b9d3-7472b6823ed3 req-d380e938-8cea-4457-9611-0d59bc860305 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.090139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:32.090277 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-e05986f1-ed03-48e8-b9d3-7472b6823ed3 req-d380e938-8cea-4457-9611-0d59bc860305 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:32.101933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-e05986f1-ed03-48e8-b9d3-7472b6823ed3 req-d380e938-8cea-4457-9611-0d59bc860305 service nova] Creating event network-changed:60d9c274-368f-4afe-81d6-9735f604892c for instance c850c82e-2876-4797-8a76-d09960544a2f on hv-cinder-83800 May 18 22:52:32.107377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-e05986f1-ed03-48e8-b9d3-7472b6823ed3 req-d380e938-8cea-4457-9611-0d59bc860305 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029664 May 18 22:52:32.108013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 493/993] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:52:32.119180 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:52:32.233759 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:32.426973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-89548c30-ffff-4aaa-9e0a-8311035a24e4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 204 len: 0 microversion: 2.1 time: 0.352027 May 18 22:52:32.431873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 501/994] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:52:32 2022] DELETE /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:52:32.439156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:32.440247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:32.448668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.449198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:32.450220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.450724 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:32.596363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:32.605209 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-47e09317-651f-4866-9623-d74e96158556 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.170804 May 18 22:52:32.606036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 494/995] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:32 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:32.988588 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:32.989284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:32.996715 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.997163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:32.997924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:32.998382 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:33.131051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:33.139107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:33.140606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:33.141753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f09c4ac2-9039-444c-b672-57f51c0e15e2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.157501 May 18 22:52:33.142337 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 502/996] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:32 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:33.623671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:33.624359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:33.631009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:33.631506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:33.632956 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:33.633388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:33.767707 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:33.776538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a804fbcb-6e74-4867-93d0-caf715eb8855 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1565 microversion: 2.1 time: 0.156624 May 18 22:52:33.777322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 495/997] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:33 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:33.951855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-059fdee6-dc20-4de8-bda3-828da38c45b6 req-280f4059-8326-42cb-97c3-e4a1fc501e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "name": "network-vif-plugged", "status": "completed", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:33.960563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-059fdee6-dc20-4de8-bda3-828da38c45b6 req-280f4059-8326-42cb-97c3-e4a1fc501e45 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:33.961010 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-059fdee6-dc20-4de8-bda3-828da38c45b6 req-280f4059-8326-42cb-97c3-e4a1fc501e45 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:33.972076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-059fdee6-dc20-4de8-bda3-828da38c45b6 req-280f4059-8326-42cb-97c3-e4a1fc501e45 service nova] Creating event network-vif-plugged:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:52:33.977767 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-059fdee6-dc20-4de8-bda3-828da38c45b6 req-280f4059-8326-42cb-97c3-e4a1fc501e45 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085138 May 18 22:52:33.978766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 503/998] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:34.160258 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:34.160873 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:34.167623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:34.168084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:34.168858 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:34.169299 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:34.302757 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:34.311762 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:34.313289 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:34.314503 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a107d268-0050-4a19-ae35-b300e61368de tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.158264 May 18 22:52:34.315080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 496/999] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:34 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:34.795986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:34.796591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:34.803376 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:34.804331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:34.805294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:34.805934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:35.001000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:35.009165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e574c64f-9bdc-4faa-a1c1-ea354a528a54 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1447 microversion: 2.1 time: 0.218186 May 18 22:52:35.009724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 504/1000] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:34 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:35.332830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:35.333560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:35.335735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-a901bbf7-c33b-4d3f-8b8e-804bab7430f9 req-fc5c3207-2c6a-4477-a48d-bc01b35b89e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c850c82e-2876-4797-8a76-d09960544a2f", "name": "network-vif-deleted", "tag": "60d9c274-368f-4afe-81d6-9735f604892c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:35.340612 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:35.341061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:35.341825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:35.342309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:35.343913 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a901bbf7-c33b-4d3f-8b8e-804bab7430f9 req-fc5c3207-2c6a-4477-a48d-bc01b35b89e9 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:35.344356 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a901bbf7-c33b-4d3f-8b8e-804bab7430f9 req-fc5c3207-2c6a-4477-a48d-bc01b35b89e9 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:35.355741 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-a901bbf7-c33b-4d3f-8b8e-804bab7430f9 req-fc5c3207-2c6a-4477-a48d-bc01b35b89e9 service nova] Creating event network-vif-deleted:60d9c274-368f-4afe-81d6-9735f604892c for instance c850c82e-2876-4797-8a76-d09960544a2f on hv-cinder-83800 May 18 22:52:35.360665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-a901bbf7-c33b-4d3f-8b8e-804bab7430f9 req-fc5c3207-2c6a-4477-a48d-bc01b35b89e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087822 May 18 22:52:35.361252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 497/1001] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:35.475008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:35.483256 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:35.484781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:35.485857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-515570b7-8134-45e7-87e6-caa46b9ad55d tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.157109 May 18 22:52:35.486431 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 505/1002] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:35 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:36.027303 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:36.028524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:36.034896 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:36.035344 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:36.036105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:36.036542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:36.104732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:36.112345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8ed8b916-7bcb-4e4c-ab94-1a2e9085d521 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1217 microversion: 2.1 time: 0.089833 May 18 22:52:36.112920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 498/1003] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:36 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:36.503897 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:36.504507 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:36.511549 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:36.515000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:36.515000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:36.515000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:36.646154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:36.655385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:36.656883 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:36.658046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6f2adacf-4f5a-4cf3-94a2-5ef495dad7dd tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.157960 May 18 22:52:36.658656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 506/1004] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:36 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:52:37.128726 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:37.129341 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:37.137343 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:37.137787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:37.138586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:37.139016 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:37.204763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:37.213680 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f9570092-d2d6-4dea-96da-5bfd64ba6e84 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1217 microversion: 2.1 time: 0.088881 May 18 22:52:37.214631 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 499/1005] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:37 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:37.676166 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:37.676770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:37.684455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:37.684902 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:37.685660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:37.686126 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:37.821899 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:37.830171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:37.831666 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:37.832803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3bddd1cb-0f91-4328-8563-fdaaafe3fd17 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1729 microversion: 2.20 time: 0.160573 May 18 22:52:37.833355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 507/1006] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:37 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:38.230091 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:38.230623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:38.237067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:38.237523 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:38.238317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:38.238753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:38.270155 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:38.270605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:38.271048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lazy-loading 'fault' on Instance uuid c850c82e-2876-4797-8a76-d09960544a2f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:52:38.312206 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd750ba769f214a88add671cf540a49cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc1f2d036414a81ba6f2e60e8292ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:38.319522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c69f186b-c225-4169-bc27-943ea26c62f4 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 200 len: 1222 microversion: 2.1 time: 0.093908 May 18 22:52:38.320093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 500/1007] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:38 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:38.850673 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:38.851199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:38.857830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:38.858290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:38.859052 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:38.859484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:39.002419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:39.012097 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:39.013594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:39.014831 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-260d1634-a37d-4ea2-af74-cc3a85a0d193 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1716 microversion: 2.20 time: 0.168129 May 18 22:52:39.015399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 508/1008] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:52:38 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 22:52:39.337363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:39.337948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] [instance: c850c82e-2876-4797-8a76-d09960544a2f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:39.344367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:39.344811 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:39.345585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:39.346027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:39.359756 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] HTTP exception thrown: Instance c850c82e-2876-4797-8a76-d09960544a2f could not be found. May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Request method failure captured: May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f HTTP/1.1 May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXdKHUUHeG2C03SUALJb0y5JByjkd4E95-zfjqQ8mBv6fNRIsSR-CSZqASmbwDL0T0_kVxt4sv9SLkALlo-N22JAMt5FJ-B_O-uJrjyDNWK2y7HxQUlxpNtQj5JYOkYUhQ9NEgrz8eumRXzDHXg6dRk3g3g2qgrfecWJMuUDIUN4XAI May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 5fc1f2d036414a81ba6f2e60e8292ab6 May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-TestShelveInstance-1342974583 May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:52:39.361393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5fc1f2d036414a81ba6f2e60e8292ab6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5fc1f2d036414a81ba6f2e60e8292ab6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5fc1f2d036414a81ba6f2e60e8292ab6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5fc1f2d036414a81ba6f2e60e8292ab6"}]}] May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-TestShelveInstance-1342974583 May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 5fc1f2d036414a81ba6f2e60e8292ab6 May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-TestShelveInstance-1342974583 May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-TestShelveInstance-1342974583-project May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: d750ba769f214a88add671cf540a49cd May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-TestShelveInstance-1342974583-project May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance c850c82e-2876-4797-8a76-d09960544a2f could not be found. May 18 22:52:39.363157 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'c850c82e-2876-4797-8a76-d09960544a2f'} May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c850c82e-2876-4797-8a76-d09960544a2f could not be found. May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:39.364280 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c850c82e-2876-4797-8a76-d09960544a2f could not be found. May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c850c82e-2876-4797-8a76-d09960544a2f could not be found. May 18 22:52:39.365889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:39.368230 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Returning 404 to user: Instance c850c82e-2876-4797-8a76-d09960544a2f could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:39.368230 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-526a725f-de80-4803-9130-fcf5561dafd8 tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f" status: 404 len: 111 microversion: 2.1 time: 0.029583 May 18 22:52:39.368230 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 501/1009] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:39 2022] GET /compute/v2.1/servers/c850c82e-2876-4797-8a76-d09960544a2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:39.568406 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-372c828b-27f5-4130-8034-1acafcbe4e2d tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] Calling method '.version_select at 0x7f6cd8ffa160>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:39.639466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-372c828b-27f5-4130-8034-1acafcbe4e2d tempest-TestShelveInstance-1342974583 tempest-TestShelveInstance-1342974583-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-33884718" status: 202 len: 0 microversion: 2.1 time: 0.074922 May 18 22:52:39.640032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 509/1010] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:52:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-33884718 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:52:39.811435 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:39.812007 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:39.818146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:39.818671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:39.819437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:39.819870 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:39.904542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'services' on Instance uuid 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:52:40.128318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-63684e9c-9615-4adc-ac5f-0b9a3d211178 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments/426e53fd-795e-4a49-8566-8e7b4c00722f" status: 202 len: 0 microversion: 2.1 time: 0.320661 May 18 22:52:40.128965 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 502/1011] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:52:39 2022] DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments/426e53fd-795e-4a49-8566-8e7b4c00722f => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:52:40.139333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:40.140978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:40.149282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:40.150074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:40.151040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:40.151475 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:40.181780 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-422e4134-caa1-4383-bee4-540c707d6458 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047187 May 18 22:52:40.182368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 510/1012] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:52:40 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:41.193910 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:41.195782 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:41.202690 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:41.203235 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:41.204112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:41.204558 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:41.240741 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5d33c801-9e13-4e1f-883f-15c83b2614b9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050901 May 18 22:52:41.245940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 503/1013] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:52:41 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:42.253128 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:42.254220 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:42.261586 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:42.265270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:42.265270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:42.265270 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:42.293411 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-99b5dd38-b080-44ad-b3f6-ca58ef75d22c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044150 May 18 22:52:42.293966 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 511/1014] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:52:42 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:52:42.353000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:42.353515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:42.359941 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:42.360388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:42.361262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:42.361713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:42.387838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:52:42.529339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:52:42.706670 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8c9bb680-6268-4bd0-be18-a9ae7a607d83 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 204 len: 0 microversion: 2.1 time: 0.358080 May 18 22:52:42.711440 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 504/1015] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:52:42 2022] DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:52:42.716979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:42.717642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:42.723971 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:42.724258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:42.725026 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:42.725460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:42.923744 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:42.936578 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-342a1389-dbd5-451a-9eea-212ff09345f4 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1680 microversion: 2.1 time: 0.223406 May 18 22:52:42.938756 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 512/1016] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:42 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:43.955468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:43.956166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:43.964234 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:43.965203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:43.965981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:43.966917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:44.102440 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:44.109955 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1a3abfcd-0db3-4aeb-8a50-1d6d7c5aa967 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1680 microversion: 2.1 time: 0.158665 May 18 22:52:44.110560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 505/1017] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:43 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:45.127947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:45.129320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:45.137395 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:45.138121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:45.139155 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:45.140029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:45.362355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:45.371718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-68cb1a1d-2f8a-4021-ab4c-a913174e51a9 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1680 microversion: 2.1 time: 0.247530 May 18 22:52:45.382284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 513/1018] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:45 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1680 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:45.840150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-2f6bcf38-07c0-4df4-951a-9367843b3882 req-7e2d2f0c-8ffd-4cb0-a7c8-3de499c98e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "532d5eb2-2c7f-4e0a-b023-4b694bc2f27b", "name": "network-vif-deleted", "tag": "6bf1412b-0088-4128-af97-c8d46ee4b076"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:52:45.842453 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2f6bcf38-07c0-4df4-951a-9367843b3882 req-7e2d2f0c-8ffd-4cb0-a7c8-3de499c98e53 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:45.842931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-2f6bcf38-07c0-4df4-951a-9367843b3882 req-7e2d2f0c-8ffd-4cb0-a7c8-3de499c98e53 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:45.854508 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-2f6bcf38-07c0-4df4-951a-9367843b3882 req-7e2d2f0c-8ffd-4cb0-a7c8-3de499c98e53 service nova] Creating event network-vif-deleted:6bf1412b-0088-4128-af97-c8d46ee4b076 for instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b on hv-cinder-83800 May 18 22:52:45.863888 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-2f6bcf38-07c0-4df4-951a-9367843b3882 req-7e2d2f0c-8ffd-4cb0-a7c8-3de499c98e53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036519 May 18 22:52:45.865009 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 506/1019] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:52:46.503072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:46.504254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:46.510330 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:46.511006 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:46.515297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:46.515297 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:46.568280 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:46.571372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:46.572116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lazy-loading 'fault' on Instance uuid 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:52:46.630834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2b45df9a7cd466593d5c8a4f30bde53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6422f1b1118143e4b8ef54927212ca97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:52:46.645525 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9f8234ec-f8f5-4a9e-b0bf-3d30e0122b1b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 200 len: 1331 microversion: 2.1 time: 0.260154 May 18 22:52:46.661651 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 514/1020] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:46 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 1331 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:52:47.670339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:47.671028 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:47.677222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:47.677678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:47.678483 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:47.678914 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:47.692521 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b HTTP/1.1 May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:52:47.694273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:47.697721 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '532d5eb2-2c7f-4e0a-b023-4b694bc2f27b'} May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:47.698735 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:47.701097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:47.702776 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:47.702776 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5fd63ea7-2a5e-49dd-9820-6d9c57619b2d tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 404 len: 111 microversion: 2.1 time: 0.030974 May 18 22:52:47.702776 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 507/1021] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:47 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:47.706434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9a637a4e-d65f-484d-8e97-2445dc938218 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '.version_select at 0x7f6cd8fea310>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:47.776195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9a637a4e-d65f-484d-8e97-2445dc938218 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466311286" status: 202 len: 0 microversion: 2.1 time: 0.074506 May 18 22:52:47.776894 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 515/1022] 10.222.0.70 () {58 vars in 1220 bytes} [Wed May 18 22:52:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466311286 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 22:52:49.804167 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:49.805278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:49.812176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:49.812623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:49.813387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:49.813823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:49.828185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b HTTP/1.1 May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:52:49.834186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.835886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '532d5eb2-2c7f-4e0a-b023-4b694bc2f27b'} May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:49.836794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.838431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:49.839970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:49.839970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-166033e9-424c-4bca-81c6-129540781d3c tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 404 len: 111 microversion: 2.1 time: 0.030842 May 18 22:52:49.839970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 508/1023] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:52:49 2022] DELETE /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:49.841179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:49.841789 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:49.848354 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:49.848804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:49.849569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:49.850026 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:49.864283 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b HTTP/1.1 May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:52:49.865990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.868486 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '532d5eb2-2c7f-4e0a-b023-4b694bc2f27b'} May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:49.869571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. May 18 22:52:49.871113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:49.872464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 532d5eb2-2c7f-4e0a-b023-4b694bc2f27b could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:49.872464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c27c76b5-056f-4591-9463-2639e952d83b tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b" status: 404 len: 111 microversion: 2.1 time: 0.030766 May 18 22:52:49.872464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 516/1024] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:49 2022] GET /compute/v2.1/servers/532d5eb2-2c7f-4e0a-b023-4b694bc2f27b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:51.122159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:51.122675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:51.129023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.129469 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.130255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.130684 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.144357 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 HTTP/1.1 May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:52:51.145875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.147539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4'} May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:51.149068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.150642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.152084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:51.152084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-c93331e0-477b-4678-bc52-7a382f48c14f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 404 len: 111 microversion: 2.1 time: 0.029215 May 18 22:52:51.152084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 509/1025] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:52:51 2022] DELETE /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:51.155704 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:51.156295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:51.162693 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.163139 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.163898 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.164458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.178610 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 HTTP/1.1 May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:52:51.180974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.182615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4'} May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:51.183521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. May 18 22:52:51.184978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.186366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:51.186366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-39a8d9cd-3103-43b9-9629-a198361abf0a tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4" status: 404 len: 111 microversion: 2.1 time: 0.030395 May 18 22:52:51.186366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 517/1026] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:51 2022] GET /compute/v2.1/servers/a16c8f8d-91ae-4bd0-aeb4-b4e139d7a8f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:51.190788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:51.191277 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:51.197846 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.198309 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.199060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.199490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.212502 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f HTTP/1.1 May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:52:51.214170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.215768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '11859bc6-9f40-4ebd-a362-f02edc56387f'} May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:51.216746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.218291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:51.219771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:51.219771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-00f0daa7-52c0-4fd0-93d4-b6c87032a739 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 404 len: 111 microversion: 2.1 time: 0.028546 May 18 22:52:51.219771 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 510/1027] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:52:51 2022] DELETE /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:51.223867 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:51.224471 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 11859bc6-9f40-4ebd-a362-f02edc56387f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:51.230559 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.231034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.231784 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:51.232237 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:51.246200 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f HTTP/1.1 May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:52:51.247795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.249450 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '11859bc6-9f40-4ebd-a362-f02edc56387f'} May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:51.250599 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. May 18 22:52:51.252045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:51.253459 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 11859bc6-9f40-4ebd-a362-f02edc56387f could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:51.253459 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dcfad528-01ed-4039-8401-653973e42a9f tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f" status: 404 len: 111 microversion: 2.1 time: 0.029076 May 18 22:52:51.253459 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 518/1028] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:51 2022] GET /compute/v2.1/servers/11859bc6-9f40-4ebd-a362-f02edc56387f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 22:52:52.496153 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:52.496699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:52.504216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:52.507355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:52.507355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:52.507355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:52.520133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f HTTP/1.1 May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:52:52.521663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.523322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '097a1c9f-e116-4327-a473-ab82fe379d7f'} May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:52.524259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.525807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:52:52.527315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:52.527315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-69158c01-339d-4edc-a4d1-5a6112689dbd tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 404 len: 111 microversion: 2.1 time: 0.031238 May 18 22:52:52.527315 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 511/1029] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:52:52 2022] DELETE /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:52:52.531839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:52:52.532447 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] [instance: 097a1c9f-e116-4327-a473-ab82fe379d7f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:52:52.538912 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:52.539361 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:52.540121 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:52:52.540555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:52:52.553724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] HTTP exception thrown: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Request method failure captured: May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f HTTP/1.1 May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXYfqdp7YctEuvrkGKAiTv2wV9CsbcC4jZtWixx93VBtiw1-BmEub6byMtOpNT6RPveHQG-uU3LnXxk1avAfGIPoj3QWUjKcMzbHcTqIyVpi_BbT8-ShHtvblqoCX80eT70pGCDrLaGQdyWvej6X81NSPm2cy9uEB01iXyM7es4O_-w May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:52:52.556201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6422f1b1118143e4b8ef54927212ca97", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6422f1b1118143e4b8ef54927212ca97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6422f1b1118143e4b8ef54927212ca97"}]}] May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 6422f1b1118143e4b8ef54927212ca97 May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1071218547 May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: f2b45df9a7cd466593d5c8a4f30bde53 May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeNegativeTest-1071218547-project May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.557658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '097a1c9f-e116-4327-a473-ab82fe379d7f'} May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:52:52.558609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. May 18 22:52:52.560351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:52:52.561660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] Returning 404 to user: Instance 097a1c9f-e116-4327-a473-ab82fe379d7f could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:52:52.561660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-39cf004d-242b-46af-a286-c717f4222b86 tempest-AttachVolumeNegativeTest-1071218547 tempest-AttachVolumeNegativeTest-1071218547-project] 10.222.0.70 "GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f" status: 404 len: 111 microversion: 2.1 time: 0.029219 May 18 22:52:52.561660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 519/1030] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:52:52 2022] GET /compute/v2.1/servers/097a1c9f-e116-4327-a473-ab82fe379d7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:53:16.052081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:53:16.052802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Wed May 18 22:53:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 22:53:17.198668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:17.199305 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:17.201642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:17.202451 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:17.207681 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:17.208133 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:17.208906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:17.209337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:17.296435 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lazy-loading 'services' on Instance uuid bb83799d-978a-401d-9194-46c104e85cf9 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:53:17.537814 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-beade901-4275-4c47-81ee-a80c2e5d6c67 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-volume_attachments/864f9519-49db-4887-a7b5-cfacfd11e098" status: 202 len: 0 microversion: 2.1 time: 0.343164 May 18 22:53:17.538570 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 512/1031] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:53:17 2022] DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-volume_attachments/864f9519-49db-4887-a7b5-cfacfd11e098 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:53:19.707577 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2728ec09-dd2a-4544-8e4a-813d7004df6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:53:19.709950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:19.710641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:19.716009 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2728ec09-dd2a-4544-8e4a-813d7004df6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:19.716458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2728ec09-dd2a-4544-8e4a-813d7004df6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:19.738633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2728ec09-dd2a-4544-8e4a-813d7004df6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Going to try to stop instance {{(pid=124367) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 18 22:53:19.874497 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2728ec09-dd2a-4544-8e4a-813d7004df6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action" status: 202 len: 0 microversion: 2.1 time: 0.170623 May 18 22:53:19.875165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 520/1032] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:53:19 2022] POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:53:19.885385 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:19.888202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:19.892681 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:19.893201 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:19.893924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:19.894386 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:20.041671 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:20.049867 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-24ca1676-c47a-4c8e-8d22-459572adcf1b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.170244 May 18 22:53:20.050465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 513/1033] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:19 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:21.067718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:21.068438 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:21.075620 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:21.076065 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:21.076819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:21.077249 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:21.209508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:21.217606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0995e6e9-ea1f-4fe9-bfae-c14d1de1a23e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.154450 May 18 22:53:21.218188 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 521/1034] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:21 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:22.234877 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:22.235411 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:22.241784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:22.242257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:22.243568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:22.244000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:22.370787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:22.378170 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7323266c-dc5e-4835-bb57-fc00df7e84c1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.147195 May 18 22:53:22.378745 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 514/1035] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:22 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:23.395284 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:23.395885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:23.402492 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:23.402935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:23.403694 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:23.404125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:23.532702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:23.540817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8085ddb3-cf40-4b12-b1b4-c3930f101694 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.149516 May 18 22:53:23.541367 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 522/1036] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:23 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:24.559063 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:24.559695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:24.565751 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:24.571098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:24.571098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:24.571098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:24.704665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:24.712845 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dd726e9e-d146-4c9c-96fc-254a5f9b59ba tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.158863 May 18 22:53:24.713764 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 515/1037] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:24 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:25.729746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:25.730359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:25.736766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:25.737213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:25.737966 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:25.738418 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:25.873946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:25.881418 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c48fc191-a77e-45d7-83a4-b810b18f84c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.155658 May 18 22:53:25.881988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 523/1038] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:25 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:26.898317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:26.899875 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:26.906371 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:26.906821 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:26.907584 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:26.908019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:27.040974 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:27.048892 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4e030d6f-a944-4739-abe4-c9132483464e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.154508 May 18 22:53:27.049391 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 516/1039] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:26 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:28.066292 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:28.066917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:28.074541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:28.075011 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:28.075800 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:28.076285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:28.210236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:28.218092 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dfb29169-0d06-4aed-b719-cd80032e72b0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.155622 May 18 22:53:28.218650 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 524/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:28 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:29.235450 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:29.236067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:29.243767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:29.244225 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:29.245001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:29.245454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:29.375777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:29.384259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-65e6de70-7099-4f59-a03c-212cc488ea04 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.152301 May 18 22:53:29.384843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 517/1041] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:29 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:30.401162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:30.401817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:30.409611 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:30.409611 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:30.409808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:30.410186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:30.545046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:30.552626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8b92b744-d613-4ba4-95af-51417925fee8 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.155942 May 18 22:53:30.553245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 525/1042] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:30 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:31.569480 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:31.570112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:31.576186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:31.576637 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:31.577395 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:31.577829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:31.713177 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:31.720705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f1c07d8f-93a5-4fda-bb50-6459bcac1e6f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.155185 May 18 22:53:31.721674 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 518/1043] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:31 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:32.738494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:32.739295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:32.746063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:32.746507 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:32.747263 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:32.747799 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:32.880773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:32.888366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d512aef3-66dd-481e-9e9b-06b7e1195929 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.154213 May 18 22:53:32.888929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 526/1044] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:32 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:33.906108 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:33.906722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:33.913331 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:33.915871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:33.915871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:33.915871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:34.048184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:34.055606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2cedbcc8-43dc-4e23-ab9d-388d84b0d60e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.153615 May 18 22:53:34.056827 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 519/1045] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:33 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:35.074248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:35.074856 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:35.081301 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:35.081746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:35.082545 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:35.083036 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:35.212199 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:35.219785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b3f4c0b8-d075-418c-a4fc-b9ee6526d756 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.149993 May 18 22:53:35.220348 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 527/1046] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:35 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:36.236270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:36.236889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:36.243291 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:36.243840 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:36.244605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:36.245036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:36.377525 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:36.385997 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1416f9e0-d273-4a52-9e72-7a234ab9a229 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.153588 May 18 22:53:36.386595 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 520/1047] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:36 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:37.403737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:37.404356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:37.410915 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:37.411365 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:37.412138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:37.412587 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:37.574432 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:37.581843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3d1ba5de-c800-4577-9a44-c5166a94168e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.182699 May 18 22:53:37.582438 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 528/1048] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:37 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:38.598310 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:38.598932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:38.605750 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:38.606297 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:38.611199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:38.611199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:38.741699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:38.749544 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0441d2db-e54d-4bcc-8a66-54c1eebb8e52 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.155255 May 18 22:53:38.754240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 521/1049] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:38 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:39.770046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:39.770656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:39.777154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:39.777595 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:39.778479 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:39.778803 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:39.912019 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:39.920131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-06dd1eb1-78ac-4d51-934b-051237994a51 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1678 microversion: 2.1 time: 0.153903 May 18 22:53:39.920825 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 529/1050] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:39 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:40.940466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:40.941080 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:40.949038 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:40.949515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:40.950524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:40.950960 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:41.092083 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:41.099627 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b2177085-d654-475f-9138-d6641e1fa080 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1655 microversion: 2.1 time: 0.165424 May 18 22:53:41.100199 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 522/1051] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:40 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:41.123479 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-15595de4-caa9-431c-b79a-b8572e79e6d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:53:41.130320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-15595de4-caa9-431c-b79a-b8572e79e6d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:41.130775 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-15595de4-caa9-431c-b79a-b8572e79e6d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:41.153813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-15595de4-caa9-431c-b79a-b8572e79e6d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Going to try to start instance {{(pid=124367) start /opt/stack/nova/nova/compute/api.py:2730}} May 18 22:53:41.330808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-15595de4-caa9-431c-b79a-b8572e79e6d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action" status: 202 len: 0 microversion: 2.1 time: 0.211002 May 18 22:53:41.331654 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 530/1052] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:53:41 2022] POST /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:53:41.340887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:41.341502 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:41.347467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:41.347945 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:41.348709 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:41.349151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:41.483872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:41.492887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3df1d82e-f0c8-469d-a14d-1050566ab0d0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1664 microversion: 2.1 time: 0.157090 May 18 22:53:41.493970 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 523/1053] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:41 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:42.512929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:42.514363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:42.521084 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:42.521535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:42.522325 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:42.522756 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:42.718808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:42.726216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9201819b-8511-4c1a-bf01-d9f83249f5b2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1664 microversion: 2.1 time: 0.218819 May 18 22:53:42.726794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 531/1054] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:42 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1664 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:43.749286 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:43.749889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:43.756376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:43.762363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:43.762363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:43.762363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:43.895027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:43.904172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-44f6dc45-d4aa-43dd-91da-2db327c975fa tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1668 microversion: 2.1 time: 0.158356 May 18 22:53:43.904344 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 524/1055] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:53:43 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:44.060047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:44.060047 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:44.069287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:44.069817 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:44.070709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:44.071215 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:44.101074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d4ac9349-1a31-4b7b-8544-9f0d33834dc0 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048020 May 18 22:53:44.101639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 532/1056] 10.222.0.70 () {60 vars in 1342 bytes} [Wed May 18 22:53:44 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:53:44.160730 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:44.161211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:44.167374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:44.167816 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:44.168823 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:44.169252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:44.193547 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:53:44.494377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ff7195a1-f50d-4141-a9c3-641c71d8ac11 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 204 len: 0 microversion: 2.20 time: 0.336555 May 18 22:53:44.494969 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 525/1057] 10.222.0.70 () {60 vars in 1279 bytes} [Wed May 18 22:53:44 2022] DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 22:53:44.503132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:44.503734 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:44.510523 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:44.510969 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:44.511732 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:44.512167 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:44.644634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:44.652541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:44.654045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:44.655186 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-06041bbf-efb9-4131-81f3-3f310054ccf5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.156024 May 18 22:53:44.655748 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 533/1058] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:44 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:53:45.674634 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:45.675321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:45.682345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:45.682784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:45.683539 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:45.683965 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:45.687917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:45.812620 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:45.820439 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:45.822162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:45.823254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ee13b98a-969b-49f4-b44a-5d1a11853a1b tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.152979 May 18 22:53:45.823817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 526/1059] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:45 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:53:46.842581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:46.843124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:46.849672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:46.850153 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:46.850917 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:46.851351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:46.870409 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:47.035645 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:47.045243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:47.046788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:47.047998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-502d6a8c-a770-4395-bb66-452b33bb29df tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1722 microversion: 2.20 time: 0.210645 May 18 22:53:47.048556 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 534/1060] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:46 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:53:47.436734 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-9a260bbe-6e6d-4b0c-b33c-6323df6c7114 req-e98c85d3-f2b2-4f4c-8b45-77d7b6722ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e6d587-6645-4e55-9b94-9ca2c2d08ffa", "name": "network-vif-deleted", "tag": "682e4566-fdfb-4a1e-8b14-8760e8fa6421"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:53:47.440845 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:47.445987 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-9a260bbe-6e6d-4b0c-b33c-6323df6c7114 req-e98c85d3-f2b2-4f4c-8b45-77d7b6722ad8 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:47.446542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-9a260bbe-6e6d-4b0c-b33c-6323df6c7114 req-e98c85d3-f2b2-4f4c-8b45-77d7b6722ad8 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:47.458924 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-9a260bbe-6e6d-4b0c-b33c-6323df6c7114 req-e98c85d3-f2b2-4f4c-8b45-77d7b6722ad8 service nova] Creating event network-vif-deleted:682e4566-fdfb-4a1e-8b14-8760e8fa6421 for instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa on hv-cinder-83800 May 18 22:53:47.464520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-9a260bbe-6e6d-4b0c-b33c-6323df6c7114 req-e98c85d3-f2b2-4f4c-8b45-77d7b6722ad8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031629 May 18 22:53:47.465143 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 527/1061] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:53:48.067259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:48.068721 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:48.075509 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:48.075952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:48.076718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:48.077150 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:48.111586 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:48.112037 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:48.112933 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lazy-loading 'fault' on Instance uuid 64e6d587-6645-4e55-9b94-9ca2c2d08ffa {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:53:48.160177 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:48.169276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:48.170816 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2ffacb9e00b8448eb56a233a5d564d0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7373826e4743088ff1d782782b9890', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:53:48.171947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-013ed817-af9f-4c7d-9fe1-0ae7eb3a0644 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 200 len: 1370 microversion: 2.20 time: 0.108736 May 18 22:53:48.172498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 535/1062] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:48 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 22:53:49.192248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:49.192946 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:49.200465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:49.200918 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:49.201705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:49.202174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:49.215936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] HTTP exception thrown: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Request method failure captured: May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa HTTP/1.1 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXalE9Q3wCiIh5n3KvwBtvzHdt9RDMr3i4uDk5C3ZpL2UCaGL25Ft_t8tDB3UnvntAuEZgFRAAd9XlPlmpTksJcBIqPSQAVx0w_xYjMU5m8gLcW-hO-ZWTlvjQd5AVVtlVgn5ztme50htBkWDIB7T9-IWtZYhpDc6ig34bqbGjHE9NE May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Openstack-Nova-Api-Version: 2.20 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:53:49.217560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a7373826e4743088ff1d782782b9890", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a7373826e4743088ff1d782782b9890"}]}] May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 2ffacb9e00b8448eb56a233a5d564d0e May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:49.219349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '64e6d587-6645-4e55-9b94-9ca2c2d08ffa'} May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:53:49.220203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:49.221538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:49.222825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Returning 404 to user: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:53:49.222825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-61afeb1a-c8ea-46bf-8552-97c871992037 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 404 len: 111 microversion: 2.20 time: 0.031463 May 18 22:53:49.222825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 528/1063] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:49 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 22:53:49.228240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bc18dbe9-dd9a-4ad1-ba43-32a11f4f98c5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '.version_select at 0x7f6cd8fea820>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:49.345446 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bc18dbe9-dd9a-4ad1-ba43-32a11f4f98c5 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731153388" status: 204 len: 0 microversion: 2.20 time: 0.121129 May 18 22:53:49.345932 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 536/1064] 10.222.0.70 () {60 vars in 1258 bytes} [Wed May 18 22:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731153388 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 22:53:51.340905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:51.341488 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:51.348329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:51.348780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:51.349550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:51.349995 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:51.365472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] HTTP exception thrown: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Request method failure captured: May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa HTTP/1.1 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXalE9Q3wCiIh5n3KvwBtvzHdt9RDMr3i4uDk5C3ZpL2UCaGL25Ft_t8tDB3UnvntAuEZgFRAAd9XlPlmpTksJcBIqPSQAVx0w_xYjMU5m8gLcW-hO-ZWTlvjQd5AVVtlVgn5ztme50htBkWDIB7T9-IWtZYhpDc6ig34bqbGjHE9NE May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Openstack-Nova-Api-Version: 2.20 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:53:51.367031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a7373826e4743088ff1d782782b9890", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a7373826e4743088ff1d782782b9890"}]}] May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 2ffacb9e00b8448eb56a233a5d564d0e May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.368865 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '64e6d587-6645-4e55-9b94-9ca2c2d08ffa'} May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:53:51.369826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.371486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:51.373179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Returning 404 to user: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:53:51.373179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-945cc744-58cc-46f5-9bc1-ddc7fad3a154 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 404 len: 111 microversion: 2.20 time: 0.032231 May 18 22:53:51.373179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 529/1065] 10.222.0.70 () {60 vars in 1279 bytes} [Wed May 18 22:53:51 2022] DELETE /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 22:53:51.377605 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:51.378247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 64e6d587-6645-4e55-9b94-9ca2c2d08ffa] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:51.380106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:53:51.386324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:51.392947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:51.392947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:51.392947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:51.401594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] HTTP exception thrown: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Request method failure captured: May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa HTTP/1.1 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXalE9Q3wCiIh5n3KvwBtvzHdt9RDMr3i4uDk5C3ZpL2UCaGL25Ft_t8tDB3UnvntAuEZgFRAAd9XlPlmpTksJcBIqPSQAVx0w_xYjMU5m8gLcW-hO-ZWTlvjQd5AVVtlVgn5ztme50htBkWDIB7T9-IWtZYhpDc6ig34bqbGjHE9NE May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Openstack-Nova-Api-Version: 2.20 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:53:51.403258 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a7373826e4743088ff1d782782b9890", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a7373826e4743088ff1d782782b9890"}]}] May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 2ffacb9e00b8448eb56a233a5d564d0e May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.405069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '64e6d587-6645-4e55-9b94-9ca2c2d08ffa'} May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:53:51.405886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. May 18 22:53:51.407152 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:51.408390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Returning 404 to user: Instance 64e6d587-6645-4e55-9b94-9ca2c2d08ffa could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:53:51.408390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e8dda5b9-f5a8-43c6-97b9-59e71d2791b2 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa" status: 404 len: 111 microversion: 2.20 time: 0.031551 May 18 22:53:51.408390 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 537/1066] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:51 2022] GET /compute/v2.1/servers/64e6d587-6645-4e55-9b94-9ca2c2d08ffa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 22:53:52.710529 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:52.711005 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:52.718023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:52.718473 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:52.719227 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:52.719656 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:52.733446 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] HTTP exception thrown: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Request method failure captured: May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 HTTP/1.1 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXalE9Q3wCiIh5n3KvwBtvzHdt9RDMr3i4uDk5C3ZpL2UCaGL25Ft_t8tDB3UnvntAuEZgFRAAd9XlPlmpTksJcBIqPSQAVx0w_xYjMU5m8gLcW-hO-ZWTlvjQd5AVVtlVgn5ztme50htBkWDIB7T9-IWtZYhpDc6ig34bqbGjHE9NE May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Openstack-Nova-Api-Version: 2.20 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:53:52.734998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a7373826e4743088ff1d782782b9890", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a7373826e4743088ff1d782782b9890"}]}] May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 2ffacb9e00b8448eb56a233a5d564d0e May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.736618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '8e35b912-5d2e-451c-b856-af4bb422a6c0'} May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:53:52.737401 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.738746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:53:52.740013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Returning 404 to user: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:53:52.740013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-29a24ffb-eb38-47df-a891-07f00a6ab9a8 tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 404 len: 111 microversion: 2.20 time: 0.029651 May 18 22:53:52.740013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 530/1067] 10.222.0.70 () {60 vars in 1279 bytes} [Wed May 18 22:53:52 2022] DELETE /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 22:53:52.744757 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:53:52.745519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] [instance: 8e35b912-5d2e-451c-b856-af4bb422a6c0] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:53:52.752570 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:52.753016 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:52.753773 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:53:52.754235 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:53:52.767066 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] HTTP exception thrown: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Request method failure captured: May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 HTTP/1.1 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXalE9Q3wCiIh5n3KvwBtvzHdt9RDMr3i4uDk5C3ZpL2UCaGL25Ft_t8tDB3UnvntAuEZgFRAAd9XlPlmpTksJcBIqPSQAVx0w_xYjMU5m8gLcW-hO-ZWTlvjQd5AVVtlVgn5ztme50htBkWDIB7T9-IWtZYhpDc6ig34bqbGjHE9NE May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Openstack-Nova-Api-Version: 2.20 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:53:52.768574 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3a7373826e4743088ff1d782782b9890", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3a7373826e4743088ff1d782782b9890"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3a7373826e4743088ff1d782782b9890"}]}] May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 3a7373826e4743088ff1d782782b9890 May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-530197286 May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 2ffacb9e00b8448eb56a233a5d564d0e May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeShelveTestJSON-530197286-project May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.770318 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '8e35b912-5d2e-451c-b856-af4bb422a6c0'} May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:53:52.771236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. May 18 22:53:52.772779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:53:52.774162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] Returning 404 to user: Instance 8e35b912-5d2e-451c-b856-af4bb422a6c0 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:53:52.774162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-36075800-d338-4c54-8c9b-dd0a228791da tempest-AttachVolumeShelveTestJSON-530197286 tempest-AttachVolumeShelveTestJSON-530197286-project] 10.222.0.70 "GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0" status: 404 len: 111 microversion: 2.20 time: 0.029150 May 18 22:53:52.774162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 538/1068] 10.222.0.70 () {60 vars in 1276 bytes} [Wed May 18 22:53:52 2022] GET /compute/v2.1/servers/8e35b912-5d2e-451c-b856-af4bb422a6c0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 22:54:07.196255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:07.196255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:07.202826 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=7 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:07.203744 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=12 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:07.205333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=14 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:07.206236 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:07.206861 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:07.207825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:07.208275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:07.242767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:54:07.402699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-6bdd59a1-c3aa-4ab7-a57c-1ef0e243256c req-ced3c828-aadc-4222-8df6-b8a42275b915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe", "tag": "61069edb-146b-4923-938f-0e918446b79b"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:07.422154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6bdd59a1-c3aa-4ab7-a57c-1ef0e243256c req-ced3c828-aadc-4222-8df6-b8a42275b915 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:07.422847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-6bdd59a1-c3aa-4ab7-a57c-1ef0e243256c req-ced3c828-aadc-4222-8df6-b8a42275b915 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:07.437046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-6bdd59a1-c3aa-4ab7-a57c-1ef0e243256c req-ced3c828-aadc-4222-8df6-b8a42275b915 service nova] Creating event network-changed:61069edb-146b-4923-938f-0e918446b79b for instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe on hv-cinder-83800 May 18 22:54:07.452794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-6bdd59a1-c3aa-4ab7-a57c-1ef0e243256c req-ced3c828-aadc-4222-8df6-b8a42275b915 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255651 May 18 22:54:07.457238 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 539/1069] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:07.556346 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9d906061-fd45-401d-b49c-670441507a44 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 204 len: 0 microversion: 2.1 time: 0.365039 May 18 22:54:07.556935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 531/1070] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:54:07 2022] DELETE /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:54:07.565792 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:07.566636 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:07.573079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:07.576640 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:07.576640 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:07.576640 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:07.727243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:07.735535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-de6ee9b9-b6a5-462c-a67b-605c7ee98ee2 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1576 microversion: 2.1 time: 0.174070 May 18 22:54:07.736103 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 540/1071] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:07 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:08.755571 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:08.756264 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:08.763271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:08.764460 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:08.765418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:08.766211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:08.997363 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:09.005089 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e08a2027-6cfd-4051-a68b-73e414e75693 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1576 microversion: 2.1 time: 0.253650 May 18 22:54:09.005660 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 532/1072] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:08 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:10.022895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:10.025287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:10.031036 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:10.031491 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:10.032275 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:10.032729 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:10.209154 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:10.217580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-14da9225-bd61-4b9a-93fb-9a9440d97d1b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1457 microversion: 2.1 time: 0.198673 May 18 22:54:10.218183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 541/1073] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:10 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1457 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:10.351054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-0110af1e-280b-4a5f-988c-5045564d7159 req-39afd03a-7d82-404b-b169-f3bedcf62477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe", "name": "network-vif-deleted", "tag": "61069edb-146b-4923-938f-0e918446b79b"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:10.359931 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0110af1e-280b-4a5f-988c-5045564d7159 req-39afd03a-7d82-404b-b169-f3bedcf62477 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:10.360409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0110af1e-280b-4a5f-988c-5045564d7159 req-39afd03a-7d82-404b-b169-f3bedcf62477 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:10.371570 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-0110af1e-280b-4a5f-988c-5045564d7159 req-39afd03a-7d82-404b-b169-f3bedcf62477 service nova] Creating event network-vif-deleted:61069edb-146b-4923-938f-0e918446b79b for instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe on hv-cinder-83800 May 18 22:54:10.376686 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-0110af1e-280b-4a5f-988c-5045564d7159 req-39afd03a-7d82-404b-b169-f3bedcf62477 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029165 May 18 22:54:10.377194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 533/1074] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:54:11.234886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:11.235419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:11.241781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:11.242266 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:11.243016 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:11.243445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:11.272984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:11.273421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:11.273854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lazy-loading 'fault' on Instance uuid b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:54:11.315117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:11.322423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c2d867eb-9972-4459-8018-8ab7d6ffe074 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 200 len: 1229 microversion: 2.1 time: 0.091420 May 18 22:54:11.322981 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 542/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:11 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:12.340032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:12.340656 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:12.347326 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:12.347781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:12.348544 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:12.348985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:12.361885 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] HTTP exception thrown: Instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe could not be found. May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Request method failure captured: May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe HTTP/1.1 May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXbtWlYObrEmgMa-rUUTaZtbjyCf3XR3deXQts_dU9IznpZ4SI3d-oG3TZNEeTcJ5-UyoO55UK6m3e-cP4-AtWl41A-ROpj6szbQ7unzFVdUuIz1tWt98e0f795Y-JV1A21zbWZpE2UaAnzYo91xsZ9IsouqWwFbiBmB19kWWq9liBU May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:54:12.363522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7994cefc64b44d1e92e94a9c8c1cca31", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7994cefc64b44d1e92e94a9c8c1cca31"}]}] May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 298370ea294c4150be7de29116e49d73 May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe could not be found. May 18 22:54:12.366279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe'} May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe could not be found. May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:54:12.367119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe could not be found. May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe could not be found. May 18 22:54:12.368390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:12.369705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Returning 404 to user: Instance b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:54:12.369705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dbbed719-3a1a-4877-a195-25d2bde71e23 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe" status: 404 len: 111 microversion: 2.1 time: 0.029277 May 18 22:54:12.369705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 534/1076] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:12 2022] GET /compute/v2.1/servers/b5c6f74a-d66f-4cf9-9823-c3d45b0b8bfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:54:15.990552 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:15.991074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:15.993577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-0ec2364f-6935-45f1-8c77-a6aeb7b31d13 req-3c9ab26b-3279-41d6-b76e-eccd4a8f6527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d633259-1327-45ac-bc36-0db6e2a3ac0d", "tag": "2170f6d7-e113-4873-9f11-d973d6171ab9"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:15.998642 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:15.999470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:16.000273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:16.000707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:16.003586 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0ec2364f-6935-45f1-8c77-a6aeb7b31d13 req-3c9ab26b-3279-41d6-b76e-eccd4a8f6527 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:16.004087 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0ec2364f-6935-45f1-8c77-a6aeb7b31d13 req-3c9ab26b-3279-41d6-b76e-eccd4a8f6527 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:16.017290 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-0ec2364f-6935-45f1-8c77-a6aeb7b31d13 req-3c9ab26b-3279-41d6-b76e-eccd4a8f6527 service nova] Creating event network-changed:2170f6d7-e113-4873-9f11-d973d6171ab9 for instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d on hv-cinder-83800 May 18 22:54:16.022548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-0ec2364f-6935-45f1-8c77-a6aeb7b31d13 req-3c9ab26b-3279-41d6-b76e-eccd4a8f6527 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032763 May 18 22:54:16.023529 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 535/1077] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:16.031012 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:54:16.351081 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd8efdd5-43cb-4178-8aa0-93f0c51e0dbc tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 204 len: 0 microversion: 2.1 time: 0.364064 May 18 22:54:16.352163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 543/1078] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:54:15 2022] DELETE /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:54:16.361478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:16.362203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:16.369028 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:16.369712 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:16.372921 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:16.374227 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:16.551337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:16.558864 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-af203fbe-cb8f-477a-b251-194b7d754da9 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1574 microversion: 2.1 time: 0.202245 May 18 22:54:16.559444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 536/1079] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:16 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:54:17.577076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:17.577691 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:17.584332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:17.584840 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:17.585650 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:17.586116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:17.724377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:17.731811 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e2c5b49c-10cf-49c1-9eeb-633f58f756eb tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1574 microversion: 2.1 time: 0.159171 May 18 22:54:17.732366 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 544/1080] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:17 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:18.605057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-eb0f98fc-523a-46cc-8725-c854aeafb6f0 req-051b59f2-3865-41a9-9430-f436f568047a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d633259-1327-45ac-bc36-0db6e2a3ac0d", "name": "network-vif-deleted", "tag": "2170f6d7-e113-4873-9f11-d973d6171ab9"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:18.614521 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-eb0f98fc-523a-46cc-8725-c854aeafb6f0 req-051b59f2-3865-41a9-9430-f436f568047a service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:18.614966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-eb0f98fc-523a-46cc-8725-c854aeafb6f0 req-051b59f2-3865-41a9-9430-f436f568047a service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:18.627664 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-eb0f98fc-523a-46cc-8725-c854aeafb6f0 req-051b59f2-3865-41a9-9430-f436f568047a service nova] Creating event network-vif-deleted:2170f6d7-e113-4873-9f11-d973d6171ab9 for instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d on hv-cinder-83800 May 18 22:54:18.632832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-eb0f98fc-523a-46cc-8725-c854aeafb6f0 req-051b59f2-3865-41a9-9430-f436f568047a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031762 May 18 22:54:18.633490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 537/1081] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:18.749834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:18.750464 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:18.757076 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:18.757524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:18.758326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:18.758748 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:18.829041 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298370ea294c4150be7de29116e49d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7994cefc64b44d1e92e94a9c8c1cca31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:18.836835 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-82cb5538-8664-469d-9d35-31224b412c92 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 200 len: 1224 microversion: 2.1 time: 0.091678 May 18 22:54:18.837399 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 545/1082] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:18 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:19.854545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:19.855257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 5d633259-1327-45ac-bc36-0db6e2a3ac0d] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:19.861929 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:19.862413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:19.863189 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:19.863645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:19.879756 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] HTTP exception thrown: Instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d could not be found. May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Request method failure captured: May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d HTTP/1.1 May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXbtWlYObrEmgMa-rUUTaZtbjyCf3XR3deXQts_dU9IznpZ4SI3d-oG3TZNEeTcJ5-UyoO55UK6m3e-cP4-AtWl41A-ROpj6szbQ7unzFVdUuIz1tWt98e0f795Y-JV1A21zbWZpE2UaAnzYo91xsZ9IsouqWwFbiBmB19kWWq9liBU May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:54:19.881376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7994cefc64b44d1e92e94a9c8c1cca31", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7994cefc64b44d1e92e94a9c8c1cca31"}]}] May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 298370ea294c4150be7de29116e49d73 May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d could not be found. May 18 22:54:19.883061 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '5d633259-1327-45ac-bc36-0db6e2a3ac0d'} May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d could not be found. May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:54:19.884146 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d could not be found. May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d could not be found. May 18 22:54:19.885676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:19.887238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Returning 404 to user: Instance 5d633259-1327-45ac-bc36-0db6e2a3ac0d could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:54:19.887238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-944833d1-df66-4894-8d57-153213b4ccae tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d" status: 404 len: 111 microversion: 2.1 time: 0.032675 May 18 22:54:19.887238 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 538/1083] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:19 2022] GET /compute/v2.1/servers/5d633259-1327-45ac-bc36-0db6e2a3ac0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:54:20.381008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:20.381008 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:20.387074 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:20.387442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:20.388234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:20.389195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:20.404033 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] HTTP exception thrown: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Request method failure captured: May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea HTTP/1.1 May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXbtWlYObrEmgMa-rUUTaZtbjyCf3XR3deXQts_dU9IznpZ4SI3d-oG3TZNEeTcJ5-UyoO55UK6m3e-cP4-AtWl41A-ROpj6szbQ7unzFVdUuIz1tWt98e0f795Y-JV1A21zbWZpE2UaAnzYo91xsZ9IsouqWwFbiBmB19kWWq9liBU May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:54:20.406514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7994cefc64b44d1e92e94a9c8c1cca31", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7994cefc64b44d1e92e94a9c8c1cca31"}]}] May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 298370ea294c4150be7de29116e49d73 May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.411007 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '6f60a91a-04f2-4c00-9a6a-fa540a8b57ea'} May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:54:20.412321 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.413870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:20.415440 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Returning 404 to user: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:54:20.415440 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aa67e39a-d338-49b6-ac59-30e90ca7417b tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 404 len: 111 microversion: 2.1 time: 0.032033 May 18 22:54:20.415440 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 546/1084] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:54:20 2022] DELETE /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:54:20.416705 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:20.417319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] [instance: 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:20.423962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:20.424415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:20.425178 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:20.425610 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:20.440303 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] HTTP exception thrown: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Request method failure captured: May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea HTTP/1.1 May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXbtWlYObrEmgMa-rUUTaZtbjyCf3XR3deXQts_dU9IznpZ4SI3d-oG3TZNEeTcJ5-UyoO55UK6m3e-cP4-AtWl41A-ROpj6szbQ7unzFVdUuIz1tWt98e0f795Y-JV1A21zbWZpE2UaAnzYo91xsZ9IsouqWwFbiBmB19kWWq9liBU May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:54:20.441820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7994cefc64b44d1e92e94a9c8c1cca31", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7994cefc64b44d1e92e94a9c8c1cca31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7994cefc64b44d1e92e94a9c8c1cca31"}]}] May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 7994cefc64b44d1e92e94a9c8c1cca31 May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-TestVolumeBootPattern-1940142891 May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 298370ea294c4150be7de29116e49d73 May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-TestVolumeBootPattern-1940142891-project May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.443409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': '6f60a91a-04f2-4c00-9a6a-fa540a8b57ea'} May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:54:20.444202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. May 18 22:54:20.445466 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:54:20.452180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Returning 404 to user: Instance 6f60a91a-04f2-4c00-9a6a-fa540a8b57ea could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:54:20.452180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a32bfe8a-1312-49f9-9c28-a8d45ee96343 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea" status: 404 len: 111 microversion: 2.1 time: 0.030766 May 18 22:54:20.452180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 539/1085] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:20 2022] GET /compute/v2.1/servers/6f60a91a-04f2-4c00-9a6a-fa540a8b57ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:54:21.953777 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-115e27d9-7252-4c5f-a9d5-ce128ac38fd0 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] Calling method '.version_select at 0x7f6cde1138b0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:22.046261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-115e27d9-7252-4c5f-a9d5-ce128ac38fd0 tempest-TestVolumeBootPattern-1940142891 tempest-TestVolumeBootPattern-1940142891-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-923270520" status: 202 len: 0 microversion: 2.1 time: 0.092189 May 18 22:54:22.046261 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 547/1086] 10.222.0.70 () {58 vars in 1259 bytes} [Wed May 18 22:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-923270520 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:54:25.875939 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-475610498", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "networks": [{"uuid": "3d911488-4233-4818-93b2-a6b29fa28fd2"}]}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:25.930633 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] validate_networks() for [('3d911488-4233-4818-93b2-a6b29fa28fd2', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:54:26.862585 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:54:26.863003 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:54:26.863498 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:54:26.863898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:54:26.864304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:54:26.873008 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:26.873448 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:26.874275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:26.874703 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:26.892091 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Getting quotas for project f3bdd150da9d4f109717fbd4a46b477e. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:54:26.896018 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Getting quotas for user 4f1e79cafd00439d859a736333d0caba and project f3bdd150da9d4f109717fbd4a46b477e. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:54:26.907302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:54:26.909562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:54:27.038358 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1cf1bf14-34c9-42f8-b894-ec35114df59a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166648 May 18 22:54:27.039302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 540/1087] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:54:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 22:54:27.049156 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e7a81b23-e5ef-4b32-ac60-de8f06111bda tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:27.049857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e7a81b23-e5ef-4b32-ac60-de8f06111bda tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:27.126623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e7a81b23-e5ef-4b32-ac60-de8f06111bda tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:27.134616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e7a81b23-e5ef-4b32-ac60-de8f06111bda tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1218 microversion: 2.1 time: 0.089243 May 18 22:54:27.135277 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 548/1088] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:27 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:28.152569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:28.153831 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:28.164748 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:28.164748 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:28.164748 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:28.164748 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:28.241177 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:28.249665 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1b86ff41-f78b-4fb5-94c5-d1e22422052b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1222 microversion: 2.1 time: 0.101320 May 18 22:54:28.259219 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 541/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:28 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:29.269359 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:29.273141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:29.276765 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:29.277235 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:29.283103 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:29.283839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:29.473706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:29.485749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fa99182b-5d4e-4972-93be-1c295b61685a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1278 microversion: 2.1 time: 0.218795 May 18 22:54:29.485749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 549/1090] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:29 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:30.500784 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:30.501648 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:30.508274 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:30.508800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:30.509806 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:30.510323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:30.780463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:30.788614 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cf94db26-fca4-4b19-b0a1-fbf6c0c11d4e tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.292285 May 18 22:54:30.794500 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 542/1091] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:30 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:31.326965 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-b246b82a-4349-438b-bcbe-185a37c94142 req-4e84e483-d05c-4bbd-89c9-ec9afb4dc1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2114a7e-f734-411f-bc6f-aac2a50326e8", "tag": "d49fe38c-dac7-41ce-8341-1d082ef92d24"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:31.335339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b246b82a-4349-438b-bcbe-185a37c94142 req-4e84e483-d05c-4bbd-89c9-ec9afb4dc1b4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:31.335802 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-b246b82a-4349-438b-bcbe-185a37c94142 req-4e84e483-d05c-4bbd-89c9-ec9afb4dc1b4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:31.347493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-b246b82a-4349-438b-bcbe-185a37c94142 req-4e84e483-d05c-4bbd-89c9-ec9afb4dc1b4 service nova] Creating event network-changed:d49fe38c-dac7-41ce-8341-1d082ef92d24 for instance f2114a7e-f734-411f-bc6f-aac2a50326e8 on hv-cinder-83800 May 18 22:54:31.351648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-b246b82a-4349-438b-bcbe-185a37c94142 req-4e84e483-d05c-4bbd-89c9-ec9afb4dc1b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029734 May 18 22:54:31.352255 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 550/1092] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:31.806372 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:31.806986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:31.813408 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:31.813854 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:31.814693 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:31.815129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:32.055461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:32.066781 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8cbd3eda-d28c-47b1-a091-1d40c2caa75d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.264150 May 18 22:54:32.077279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 543/1093] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:31 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:33.085653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:33.086379 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:33.092754 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:33.093204 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:33.093974 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:33.094443 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:33.225967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:33.234115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-907e80f8-7452-4a3c-a46b-bf0d9e578b23 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.153084 May 18 22:54:33.234680 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 551/1094] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:33 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:34.251517 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:34.252030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:34.258800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:34.259248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:34.260032 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:34.260465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:34.391543 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:34.398912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7d136f33-ef52-408a-b477-44bcda3026ad tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.152006 May 18 22:54:34.399674 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 544/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:34 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:35.415580 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:35.416201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:35.423648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:35.424107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:35.424885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:35.425328 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:35.583678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:35.591434 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0b523ddf-556d-4951-a5a1-e7e1979733da tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.179528 May 18 22:54:35.591978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 552/1096] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:35 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:36.541669 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-800691b8-fb57-4bb9-a878-cf423f8d009c req-7423de40-40f6-4ad9-8e29-a0f8c568e77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2114a7e-f734-411f-bc6f-aac2a50326e8", "name": "network-vif-plugged", "status": "completed", "tag": "d49fe38c-dac7-41ce-8341-1d082ef92d24"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:36.551642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-800691b8-fb57-4bb9-a878-cf423f8d009c req-7423de40-40f6-4ad9-8e29-a0f8c568e77d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:36.552119 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-800691b8-fb57-4bb9-a878-cf423f8d009c req-7423de40-40f6-4ad9-8e29-a0f8c568e77d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:36.563674 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-800691b8-fb57-4bb9-a878-cf423f8d009c req-7423de40-40f6-4ad9-8e29-a0f8c568e77d service nova] Creating event network-vif-plugged:d49fe38c-dac7-41ce-8341-1d082ef92d24 for instance f2114a7e-f734-411f-bc6f-aac2a50326e8 on hv-cinder-83800 May 18 22:54:36.568998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-800691b8-fb57-4bb9-a878-cf423f8d009c req-7423de40-40f6-4ad9-8e29-a0f8c568e77d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031203 May 18 22:54:36.569609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 545/1097] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:36.609823 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:36.610267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:36.617089 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:36.617534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:36.618331 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:36.618788 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:36.751951 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:36.759590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-acdf852b-e0ab-448d-a777-d92fbf96ea03 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.154801 May 18 22:54:36.760161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 553/1098] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:36 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:37.777258 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:37.777951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:37.780570 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:37.781268 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:37.782373 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:37.787388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:37.787844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:37.788940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:37.789380 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:37.793910 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:37.926801 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:37.934211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d6c8e974-ed5f-4aee-a219-cfaefd9986f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1318 microversion: 2.1 time: 0.161189 May 18 22:54:37.934825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 546/1099] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:37 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:38.950943 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:38.952131 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:38.954195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:38.955322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:38.960071 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:38.960525 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:38.961294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:38.961734 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:38.965663 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:54:39.097905 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:39.105254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ef8d7250-5777-422b-97b2-697a5589d44d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1507 microversion: 2.1 time: 0.158220 May 18 22:54:39.106036 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 554/1100] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:38 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:42.151026 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:42.151951 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:42.160135 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:42.160580 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:42.161347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:42.161774 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:42.191394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0dc168dd-fc61-44b2-9843-f5941ed8a8e0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044169 May 18 22:54:42.191948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 547/1101] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:54:42 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:54:42.249606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:42.250194 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:42.258500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:42.258946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:42.259708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:42.260143 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:42.287356 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:54:42.594698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3a2cc558-1eba-443b-bcb0-d90b591ca14a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 204 len: 0 microversion: 2.1 time: 0.348923 May 18 22:54:42.595300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 555/1102] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:54:42 2022] DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:54:42.604240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:42.605005 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:42.612933 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:42.613471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:42.614495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:42.614855 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:42.748596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:42.756695 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d82130ae-b7a7-44f2-9ca7-95311e6d8ed3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1674 microversion: 2.1 time: 0.157156 May 18 22:54:42.757260 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 548/1103] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:42 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:44.010891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:44.011591 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:44.018477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:44.018926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:44.019682 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:44.020113 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:44.152322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:44.160600 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c900e738-c724-47b0-99bc-7054d8915a8a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1674 microversion: 2.1 time: 0.390425 May 18 22:54:44.161171 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 556/1104] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:43 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1674 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:45.179409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:45.179968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:45.186548 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:45.187053 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:45.187841 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:45.188285 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:45.425843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:45.433786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fa72b01a-3ecb-4cf6-9b14-63e25c6cc266 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1674 microversion: 2.1 time: 0.258287 May 18 22:54:45.434213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 549/1105] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:45 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1674 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:46.444927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-51183c68-1518-47c2-b500-bc8496e3e8c7 req-45fe1ab4-da9c-4d5e-bdcf-79966039f078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb83799d-978a-401d-9194-46c104e85cf9", "name": "network-vif-deleted", "tag": "ae773bbc-f6df-49bb-ac08-6fa413e7c067"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:46.452097 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:46.461250 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:46.461407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-51183c68-1518-47c2-b500-bc8496e3e8c7 req-45fe1ab4-da9c-4d5e-bdcf-79966039f078 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:46.461407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-51183c68-1518-47c2-b500-bc8496e3e8c7 req-45fe1ab4-da9c-4d5e-bdcf-79966039f078 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:46.461651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:46.461651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:46.461897 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:46.462213 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:46.471598 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-51183c68-1518-47c2-b500-bc8496e3e8c7 req-45fe1ab4-da9c-4d5e-bdcf-79966039f078 service nova] Creating event network-vif-deleted:ae773bbc-f6df-49bb-ac08-6fa413e7c067 for instance bb83799d-978a-401d-9194-46c104e85cf9 on hv-cinder-83800 May 18 22:54:46.477950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-51183c68-1518-47c2-b500-bc8496e3e8c7 req-45fe1ab4-da9c-4d5e-bdcf-79966039f078 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036684 May 18 22:54:46.480383 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 557/1106] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:46.546194 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:46.557992 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ac59c32b-2cf5-4fca-9f6f-737a046bb3c4 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 200 len: 1607 microversion: 2.1 time: 0.108224 May 18 22:54:46.559365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 550/1107] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:46 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 1607 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:54:47.577975 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:47.578689 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:47.588644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:47.589088 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:47.589857 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:47.590332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:47.604575 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] HTTP exception thrown: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Request method failure captured: May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 HTTP/1.1 May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXgIxF6RmBSboOLuO0gFEPXWHSPhjc00EQ0ys0t4TjPdPMm0a7r3qRwnDI3A2c43gRECVMlMbfr2_FhWrJO2gKS9lVIqxG2BlCIQRGPpwuzPjb25OqcysPPfJRcpQTtXAOsqlnP8lI06yaz8EKbegOspfJACPGf1fPWAJEBtnTPH9Fw May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:54:47.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89ab9bb65d8a44348faf97c7d19d8c84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89ab9bb65d8a44348faf97c7d19d8c84"}]}] May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeTestJSON-735976981 May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeTestJSON-735976981-project May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 18d0bc67048c4bbb893f2589800c4535 May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeTestJSON-735976981-project May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:54:47.607986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'bb83799d-978a-401d-9194-46c104e85cf9'} May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:54:47.608983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:54:47.610629 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:54:47.612939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Returning 404 to user: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:54:47.612939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b6d08daf-211d-4426-97ad-a2644ad709e2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 404 len: 111 microversion: 2.1 time: 0.034768 May 18 22:54:47.612939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 558/1108] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:47 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:54:47.618278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b80f6f28-6799-4f67-957f-6c4eabc01e4a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '.version_select at 0x7f6cd914d940>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:47.698162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b80f6f28-6799-4f67-957f-6c4eabc01e4a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285274962" status: 202 len: 0 microversion: 2.1 time: 0.084109 May 18 22:54:47.698753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 551/1109] 10.222.0.70 () {58 vars in 1220 bytes} [Wed May 18 22:54:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285274962 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:54:48.474718 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e089f853-c32f-499c-b8e7-8f21adc4c73e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: .version_select at 0x7f6cde04f430>, body: {"keypair": {"name": "tempest-keypair-1116528282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkw2zYsg3PZNS2viNAYoAje597cbIaK+KvMFJnhXkRxTDpinhSjmpvQSy/U3j9KJZlzS9eXZHQJnbKVs1iQTDPZVgpJRALKARtvcfRWTDuETdXHI3rjtGpYpT0qETpejQ=="}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:48.488924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-e089f853-c32f-499c-b8e7-8f21adc4c73e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:54:48.492665 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-e089f853-c32f-499c-b8e7-8f21adc4c73e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for user 18d0bc67048c4bbb893f2589800c4535 and project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'key_pairs'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:54:48.579726 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e089f853-c32f-499c-b8e7-8f21adc4c73e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109777 May 18 22:54:48.581118 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 559/1110] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:54:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:54:50.569444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:54:50.570216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 22:54:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 22:54:50.809807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-131562860", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68b3ef45-4681-44c9-a6ac-fa6061c84cda"}], "security_groups": [{"name": "tempest-securitygroup--1668842214"}], "key_name": "tempest-keypair-1116528282", "user_data": "}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:50.909259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] validate_networks() for [('68b3ef45-4681-44c9-a6ac-fa6061c84cda', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:54:51.273359 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:54:51.273775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:54:51.274273 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:54:51.274676 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:54:51.275191 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:54:51.284352 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:51.284892 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:51.285788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:51.286251 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:51.304242 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:54:51.308222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Getting quotas for user 18d0bc67048c4bbb893f2589800c4535 and project 89ab9bb65d8a44348faf97c7d19d8c84. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:54:51.319141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:54:51.321409 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:54:51.431424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3cdcf329-3369-4c97-b41e-cadaa4bdbac1 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.626475 May 18 22:54:51.432065 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 552/1111] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:54:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:54:51.442378 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-eb4e18e5-0d99-4f94-9fab-4de6726f687a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:51.442984 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-eb4e18e5-0d99-4f94-9fab-4de6726f687a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:51.500870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-eb4e18e5-0d99-4f94-9fab-4de6726f687a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:51.508149 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-eb4e18e5-0d99-4f94-9fab-4de6726f687a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1237 microversion: 2.1 time: 0.070090 May 18 22:54:51.509441 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 560/1112] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:51 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:52.524484 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ef28d198-6dfd-49e1-ae4b-4741c512be46 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:52.525092 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ef28d198-6dfd-49e1-ae4b-4741c512be46 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:52.581761 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ef28d198-6dfd-49e1-ae4b-4741c512be46 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:52.588501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ef28d198-6dfd-49e1-ae4b-4741c512be46 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1237 microversion: 2.1 time: 0.068403 May 18 22:54:52.589060 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 553/1113] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:52 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:53.605458 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:53.606095 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:53.612345 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:53.613145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:53.614529 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:53.615295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:53.678027 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:53.685423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c3792666-b330-4977-b3fe-2626145bfca2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1241 microversion: 2.1 time: 0.083941 May 18 22:54:53.685920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 561/1114] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:53 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:54.702990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:54.703526 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:54.710582 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:54.711022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:54.711780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:54.712212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:54.776998 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:54.785212 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-07b5e679-cb93-49e5-bc47-efdf39bfaa72 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1233 microversion: 2.1 time: 0.086684 May 18 22:54:54.785788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 554/1115] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:54 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:55.801987 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:55.805658 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:55.809072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:55.809789 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:55.810547 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:55.810980 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:55.910522 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:55.918333 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f17c960e-d610-4fc2-87fa-04b54bf2de77 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1295 microversion: 2.1 time: 0.120435 May 18 22:54:55.918893 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 562/1116] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:55 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:56.934879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:56.939460 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:56.941983 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:56.942463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:56.943220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:56.943651 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:57.104312 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-3accd985-6965-4de0-be5a-3b619cdc5112 req-46923843-d501-47c1-85fc-d8606d7baa68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5f84ab-5397-4ccd-81d3-679188165067", "tag": "baf6c80c-9108-4eaf-a0c0-47d115e3d88f"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:54:57.115184 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3accd985-6965-4de0-be5a-3b619cdc5112 req-46923843-d501-47c1-85fc-d8606d7baa68 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:57.115997 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3accd985-6965-4de0-be5a-3b619cdc5112 req-46923843-d501-47c1-85fc-d8606d7baa68 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:57.133341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-3accd985-6965-4de0-be5a-3b619cdc5112 req-46923843-d501-47c1-85fc-d8606d7baa68 service nova] Creating event network-changed:baf6c80c-9108-4eaf-a0c0-47d115e3d88f for instance bf5f84ab-5397-4ccd-81d3-679188165067 on hv-cinder-83800 May 18 22:54:57.139950 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-3accd985-6965-4de0-be5a-3b619cdc5112 req-46923843-d501-47c1-85fc-d8606d7baa68 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039165 May 18 22:54:57.145246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 563/1117] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:54:57.147261 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:57.155277 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9bdbb9ef-6eba-4b3d-8338-a882ddcf74f3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.224105 May 18 22:54:57.157764 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 555/1118] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:56 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:58.173985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:58.175344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:58.181481 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:58.181920 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:58.182699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:58.183134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:58.310405 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:58.317851 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5fa02fa6-a5a8-42ab-9ae6-bd01b7414719 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.148553 May 18 22:54:58.318442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 564/1119] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:58 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:54:59.334599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:54:59.335159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:54:59.341609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:59.342084 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:59.342844 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:54:59.343276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:54:59.475891 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:54:59.483304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8c8b9e77-0348-4d5d-8049-fdafba233c2d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.153322 May 18 22:54:59.483869 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 556/1120] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:54:59 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:00.500494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:00.501156 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:00.507810 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:00.508267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:00.509029 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:00.509492 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:00.635776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:00.644265 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7400be85-0d20-4a6c-960e-359933886514 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.146596 May 18 22:55:00.644834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 565/1121] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:00 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:01.661431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:01.662054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:01.663902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:01.669011 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:01.669459 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:01.670249 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:01.670687 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:01.799441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:01.807311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6386ad39-33e3-47fc-a5b7-1b1f2252133a tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.150224 May 18 22:55:01.808030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 557/1122] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:01 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:01.846758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6cd8941d-1ee1-40bb-a7b7-9168bbdee223", "device": "/dev/sdb"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:01.848334 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:01.850919 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:01.855714 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:01.856219 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:01.856931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:01.857368 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:02.524766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d8143b5f-4cf1-4e35-984f-aacafa764a95 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "POST /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.681827 May 18 22:55:02.525341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 566/1123] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:55:01 2022] POST /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8/os-volume_attachments => generated 194 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:55:02.824554 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:02.825156 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:02.827069 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=8 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:02.832817 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:02.833384 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:02.834113 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:02.834550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:02.970657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:02.978285 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ea0cc107-1ce6-4685-ba7e-ec7fae1ba5bd tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.157527 May 18 22:55:02.978859 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 558/1124] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:02 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:03.995993 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:03.996750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:04.004196 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:04.004647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:04.005421 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:04.005861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:04.134514 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:04.142024 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-220c923f-58f1-4695-962c-fa1c6d064b11 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.150183 May 18 22:55:04.142609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 567/1125] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:03 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:04.751198 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-ff6dea17-68ca-464e-98ac-fb1c139a680f req-4e8238ce-a60c-4b19-a51e-77afd2ab4bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5f84ab-5397-4ccd-81d3-679188165067", "name": "network-vif-plugged", "status": "completed", "tag": "baf6c80c-9108-4eaf-a0c0-47d115e3d88f"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:04.762434 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-ff6dea17-68ca-464e-98ac-fb1c139a680f req-4e8238ce-a60c-4b19-a51e-77afd2ab4bc9 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:04.762881 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-ff6dea17-68ca-464e-98ac-fb1c139a680f req-4e8238ce-a60c-4b19-a51e-77afd2ab4bc9 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:04.781337 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-ff6dea17-68ca-464e-98ac-fb1c139a680f req-4e8238ce-a60c-4b19-a51e-77afd2ab4bc9 service nova] Creating event network-vif-plugged:baf6c80c-9108-4eaf-a0c0-47d115e3d88f for instance bf5f84ab-5397-4ccd-81d3-679188165067 on hv-cinder-83800 May 18 22:55:04.787039 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-ff6dea17-68ca-464e-98ac-fb1c139a680f req-4e8238ce-a60c-4b19-a51e-77afd2ab4bc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041800 May 18 22:55:04.787638 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 559/1126] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:55:05.159734 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:05.160350 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:05.167006 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:05.167723 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:05.168494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:05.168931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:05.299386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:05.306877 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-aa75d66b-c953-40c6-bf90-76a015d835c7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.151343 May 18 22:55:05.307439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 568/1127] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:05 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:06.325246 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:06.325830 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:06.332533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:06.332975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:06.333741 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:06.334204 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:06.467355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:06.477030 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-2e984294-9ae7-4365-95eb-036de40909af tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1363 microversion: 2.1 time: 0.156516 May 18 22:55:06.477603 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 560/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:06 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:07.494140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:07.494744 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:07.501422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:07.501866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:07.503322 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:07.503750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:07.634895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:07.642213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5dce9dca-49c9-411c-97c2-e090fc305865 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1549 microversion: 2.1 time: 0.152079 May 18 22:55:07.642782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 569/1129] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:07 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:07.659378 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:07.659906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:07.666351 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:07.666808 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:07.667838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:07.668304 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:07.744002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7f8044c1-bbfd-493f-afb0-c048ca979e5c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088490 May 18 22:55:07.744646 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 561/1130] 10.222.0.70 () {58 vars in 1274 bytes} [Wed May 18 22:55:07 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:55:08.972287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-3606aebd-e8eb-4bca-b290-b916af29f191 req-d10a2fb3-e701-45f9-b9ea-e06b2b91fb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5f84ab-5397-4ccd-81d3-679188165067", "tag": "baf6c80c-9108-4eaf-a0c0-47d115e3d88f"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:08.981532 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3606aebd-e8eb-4bca-b290-b916af29f191 req-d10a2fb3-e701-45f9-b9ea-e06b2b91fb4c service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:08.981973 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-3606aebd-e8eb-4bca-b290-b916af29f191 req-d10a2fb3-e701-45f9-b9ea-e06b2b91fb4c service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:08.993988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-3606aebd-e8eb-4bca-b290-b916af29f191 req-d10a2fb3-e701-45f9-b9ea-e06b2b91fb4c service nova] Creating event network-changed:baf6c80c-9108-4eaf-a0c0-47d115e3d88f for instance bf5f84ab-5397-4ccd-81d3-679188165067 on hv-cinder-83800 May 18 22:55:08.999685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-3606aebd-e8eb-4bca-b290-b916af29f191 req-d10a2fb3-e701-45f9-b9ea-e06b2b91fb4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032163 May 18 22:55:09.000289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 570/1131] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:55:30.220622 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:30.221382 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=73 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:30.225566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:30.225991 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:30.231760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:30.233140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:30.233140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:30.233562 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:30.316895 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lazy-loading 'services' on Instance uuid f2114a7e-f734-411f-bc6f-aac2a50326e8 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:55:30.560044 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b28e5139-c346-457f-bf4e-0d6a027d1325 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8/os-volume_attachments/6cd8941d-1ee1-40bb-a7b7-9168bbdee223" status: 202 len: 0 microversion: 2.1 time: 0.340698 May 18 22:55:30.560645 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 562/1132] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:55:30 2022] DELETE /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8/os-volume_attachments/6cd8941d-1ee1-40bb-a7b7-9168bbdee223 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:55:32.727698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:32.728276 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:32.730834 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:32.731484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:32.736305 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:32.736747 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:32.737500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:32.737929 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:32.764706 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:55:32.966035 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a072cbcc-2eda-4f70-867e-09a07d4945a6 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 204 len: 0 microversion: 2.1 time: 0.242235 May 18 22:55:32.966564 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 571/1133] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:55:32 2022] DELETE /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:55:32.976200 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:32.976894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:32.983240 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:32.983692 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:32.984458 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:32.984895 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:33.116389 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:33.123992 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f70c20f0-1d35-40fc-bdc0-502f20af17b8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1513 microversion: 2.1 time: 0.153061 May 18 22:55:33.124599 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 563/1134] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:32 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:34.141307 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:34.141940 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:34.149035 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:34.149478 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:34.150267 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:34.150698 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:34.281632 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:34.289804 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-37a3bd7b-0ae7-43c7-a606-4a41828ce4a0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1513 microversion: 2.1 time: 0.152742 May 18 22:55:34.290404 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 572/1135] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:34 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:35.316162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:35.316162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:35.316162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:35.316162 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:35.317036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:35.317036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:35.515441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:35.523514 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-11081630-5b1e-4502-b686-4f586702eb54 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 200 len: 1513 microversion: 2.1 time: 0.220860 May 18 22:55:35.524079 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 564/1136] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:35 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:35.543996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-2edb32cd-f9aa-406b-a3f9-a088e24d6cad req-e4df14fb-d069-401e-9cb1-9fd6a91ac528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2114a7e-f734-411f-bc6f-aac2a50326e8", "name": "network-vif-deleted", "tag": "d49fe38c-dac7-41ce-8341-1d082ef92d24"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:35.552763 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-2edb32cd-f9aa-406b-a3f9-a088e24d6cad req-e4df14fb-d069-401e-9cb1-9fd6a91ac528 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:35.553240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-2edb32cd-f9aa-406b-a3f9-a088e24d6cad req-e4df14fb-d069-401e-9cb1-9fd6a91ac528 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:35.564445 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-2edb32cd-f9aa-406b-a3f9-a088e24d6cad req-e4df14fb-d069-401e-9cb1-9fd6a91ac528 service nova] Creating event network-vif-deleted:d49fe38c-dac7-41ce-8341-1d082ef92d24 for instance f2114a7e-f734-411f-bc6f-aac2a50326e8 on hv-cinder-83800 May 18 22:55:35.570272 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-2edb32cd-f9aa-406b-a3f9-a088e24d6cad req-e4df14fb-d069-401e-9cb1-9fd6a91ac528 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030284 May 18 22:55:35.570990 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 573/1137] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:55:36.539863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:36.540455 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: f2114a7e-f734-411f-bc6f-aac2a50326e8] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:36.547256 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:36.547710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:36.548472 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:36.548915 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:36.563388 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] HTTP exception thrown: Instance f2114a7e-f734-411f-bc6f-aac2a50326e8 could not be found. May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Request method failure captured: May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 HTTP/1.1 May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXkfCEvgnOW5wOvHwlHSI7-3FeF0EMgYW4P3FnOcGTvrDbPNzgNJl8nhCZ3rBYikwlV1JGFzkMqnMq9Y8pYdOFap6h3vuqZimv918k8IE4F5A4Ea5AgvH0UaxdwkwiEuypqAOV1rQ71wMl8QJf4LvdGLsoXtoBoDTbVuj6KaT3Ul6Wk May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: f3bdd150da9d4f109717fbd4a46b477e May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1813128956 May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:55:36.565019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3bdd150da9d4f109717fbd4a46b477e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3bdd150da9d4f109717fbd4a46b477e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3bdd150da9d4f109717fbd4a46b477e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3bdd150da9d4f109717fbd4a46b477e"}]}] May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-VolumesSnapshotTestJSON-1813128956 May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: f3bdd150da9d4f109717fbd4a46b477e May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1813128956 May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-VolumesSnapshotTestJSON-1813128956-project May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 4f1e79cafd00439d859a736333d0caba May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-VolumesSnapshotTestJSON-1813128956-project May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance f2114a7e-f734-411f-bc6f-aac2a50326e8 could not be found. May 18 22:55:36.566837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'f2114a7e-f734-411f-bc6f-aac2a50326e8'} May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2114a7e-f734-411f-bc6f-aac2a50326e8 could not be found. May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:55:36.567759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2114a7e-f734-411f-bc6f-aac2a50326e8 could not be found. May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2114a7e-f734-411f-bc6f-aac2a50326e8 could not be found. May 18 22:55:36.569694 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:55:36.571149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Returning 404 to user: Instance f2114a7e-f734-411f-bc6f-aac2a50326e8 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:55:36.571149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cd7b666d-baf9-494a-9a5a-fae77d94c99a tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8" status: 404 len: 111 microversion: 2.1 time: 0.030443 May 18 22:55:36.571149 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 565/1138] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:36 2022] GET /compute/v2.1/servers/f2114a7e-f734-411f-bc6f-aac2a50326e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:55:47.985697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1810046531", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "networks": [{"uuid": "3d911488-4233-4818-93b2-a6b29fa28fd2"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:47.993252 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:47.993898 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:48.042072 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] validate_networks() for [('3d911488-4233-4818-93b2-a6b29fa28fd2', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:55:48.484983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:55:48.485405 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:55:48.485912 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:55:48.486369 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:55:48.486782 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:55:48.497165 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:48.497602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:48.498633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:48.499125 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:48.516254 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Getting quotas for project f3bdd150da9d4f109717fbd4a46b477e. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:55:48.520116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Getting quotas for user 4f1e79cafd00439d859a736333d0caba and project f3bdd150da9d4f109717fbd4a46b477e. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:55:48.531044 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:55:48.533363 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:55:48.665287 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-744de18c-98c9-41ed-afc5-15980b4bd36d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683763 May 18 22:55:48.666045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 574/1139] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:55:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:55:48.676073 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-513596d2-3678-4a55-b002-6fcad88f22f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:48.676814 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-513596d2-3678-4a55-b002-6fcad88f22f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:48.680301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=8 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:48.681775 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:48.734785 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-513596d2-3678-4a55-b002-6fcad88f22f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:48.742186 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-513596d2-3678-4a55-b002-6fcad88f22f2 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1219 microversion: 2.1 time: 0.069189 May 18 22:55:48.742759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 566/1140] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:48 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:49.759299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:49.759900 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:49.767207 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:49.767652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:49.768533 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:49.768890 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:49.833428 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:49.840895 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4bb0977f-058b-46fc-a36a-860affcfe7e0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1215 microversion: 2.1 time: 0.085893 May 18 22:55:49.841524 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 575/1141] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:49 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:50.858691 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:50.859323 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:50.867940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:50.867940 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:50.868444 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:50.868873 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:50.940437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:50.948871 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0c5ea003-fe96-499f-942e-2af5c73169a5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1277 microversion: 2.1 time: 0.093921 May 18 22:55:50.957688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 567/1142] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:50 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:51.964847 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:51.965462 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:51.971931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:51.972373 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:51.973192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:51.973626 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:52.108224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-c8497180-1d48-41c0-89f7-5630c8ac4fef req-0f03aa26-8de2-43ca-9763-8c5b1247974f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1201fd1-d9b5-41c8-9260-3d53bde4b40c", "tag": "5eeeb37c-5db5-47d3-9217-eac8b553b46c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:52.116793 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c8497180-1d48-41c0-89f7-5630c8ac4fef req-0f03aa26-8de2-43ca-9763-8c5b1247974f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:52.117367 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-c8497180-1d48-41c0-89f7-5630c8ac4fef req-0f03aa26-8de2-43ca-9763-8c5b1247974f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:52.128892 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-c8497180-1d48-41c0-89f7-5630c8ac4fef req-0f03aa26-8de2-43ca-9763-8c5b1247974f service nova] Creating event network-changed:5eeeb37c-5db5-47d3-9217-eac8b553b46c for instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c on hv-cinder-83800 May 18 22:55:52.134217 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-c8497180-1d48-41c0-89f7-5630c8ac4fef req-0f03aa26-8de2-43ca-9763-8c5b1247974f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030078 May 18 22:55:52.135022 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 568/1143] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:55:52.170884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:52.178615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3ceb29c2-d6ed-41a2-90cd-ff59fd93a66f tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.217876 May 18 22:55:52.179183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 576/1144] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:51 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:53.195640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:53.196370 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:53.203105 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:53.203547 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:53.204302 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:53.204911 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:53.331461 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:53.338920 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4545fdac-5929-4ab4-9544-abac79b0b6f5 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.147700 May 18 22:55:53.339487 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 569/1145] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:53 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:54.355727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:54.356290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:54.362535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:54.362988 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:54.363848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:54.364282 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:54.492859 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:54.500424 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-4411d500-9251-4d9f-96d9-9f0ffc0eff92 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.148664 May 18 22:55:54.500978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 577/1146] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:54 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:55.516894 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:55.517490 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:55.524588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:55.525033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:55.525788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:55.526245 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:55.650616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:55.657902 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-fea0235c-fdd3-477d-9405-6b826662ae1b tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.144826 May 18 22:55:55.658501 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 570/1147] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:55 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:56.674377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:56.675018 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:56.681935 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:56.682415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:56.683176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:56.683616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:56.817432 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:56.825236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fdc14501-21c7-47a3-bbe0-02b7b2053a70 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.154629 May 18 22:55:56.825807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 578/1148] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:56 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:57.842325 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:57.842901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:57.849233 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:57.849683 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:57.850481 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:57.850929 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:57.989538 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:57.999739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-875a9fef-5f1e-41f4-844a-c1507a50f821 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.161318 May 18 22:55:58.000327 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 571/1149] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:57 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:55:58.925548 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-ff8a6000-3d72-4d39-b7f4-e5682f89110f req-5dab1aa7-625d-4cb5-af40-6c7d63d84c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1201fd1-d9b5-41c8-9260-3d53bde4b40c", "name": "network-vif-plugged", "status": "completed", "tag": "5eeeb37c-5db5-47d3-9217-eac8b553b46c"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:55:58.929719 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:58.930455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:58.935716 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ff8a6000-3d72-4d39-b7f4-e5682f89110f req-5dab1aa7-625d-4cb5-af40-6c7d63d84c2f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:58.936162 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-ff8a6000-3d72-4d39-b7f4-e5682f89110f req-5dab1aa7-625d-4cb5-af40-6c7d63d84c2f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:58.947145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-ff8a6000-3d72-4d39-b7f4-e5682f89110f req-5dab1aa7-625d-4cb5-af40-6c7d63d84c2f service nova] Creating event network-vif-plugged:5eeeb37c-5db5-47d3-9217-eac8b553b46c for instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c on hv-cinder-83800 May 18 22:55:58.952115 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-ff8a6000-3d72-4d39-b7f4-e5682f89110f req-5dab1aa7-625d-4cb5-af40-6c7d63d84c2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030320 May 18 22:55:58.955794 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 579/1150] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:55:59.016567 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:55:59.017179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:55:59.019166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:55:59.024907 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:59.025426 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:59.026269 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:55:59.026698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:55:59.160353 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:55:59.168877 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-cc0d496d-2b84-4d16-b2f6-222825faa623 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.156101 May 18 22:55:59.169438 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 572/1151] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:55:59 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:00.186915 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:00.187643 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:00.194508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:00.195537 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:00.196310 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:00.196753 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:00.324038 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:56:00.331495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-68d4223e-099e-438a-ad43-169253edb0b0 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.149637 May 18 22:56:00.332057 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 580/1152] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:00 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:01.348112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:01.349332 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:01.356457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:01.356963 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:01.357733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:01.358211 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:01.487605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:56:01.495208 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d6bceb6d-5c92-4061-8fc6-7635e6295cb3 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1319 microversion: 2.1 time: 0.151547 May 18 22:56:01.495869 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 573/1153] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:01 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:02.512188 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:02.512843 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:02.519820 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:02.520260 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:02.521014 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:02.521442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:02.652206 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:56:02.659634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-743d4ac4-0d9e-4986-bdcd-6cab73e3e780 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1508 microversion: 2.1 time: 0.151971 May 18 22:56:02.660192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 581/1154] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:02 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:02.675980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bddc9ef1-d4b4-4623-8eda-7df38b50cccc", "device": "/dev/sdb"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:56:02.677532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:02.684437 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:02.684901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:02.685643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:02.686112 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:03.362023 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d6c4ec23-609f-493e-abf4-5c7d883a4315 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "POST /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689646 May 18 22:56:03.362702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 574/1155] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:56:02 2022] POST /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:56:26.267830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:26.268510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:26.271299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:26.271966 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=40 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:26.277727 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:26.278202 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:26.278968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:26.279405 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:26.404090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lazy-loading 'services' on Instance uuid d1201fd1-d9b5-41c8-9260-3d53bde4b40c {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:56:26.637557 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-958b6379-3764-4d2d-b367-eb7b3fbb60ae tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c/os-volume_attachments/bddc9ef1-d4b4-4623-8eda-7df38b50cccc" status: 202 len: 0 microversion: 2.1 time: 0.373604 May 18 22:56:26.638250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 582/1156] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:56:26 2022] DELETE /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c/os-volume_attachments/bddc9ef1-d4b4-4623-8eda-7df38b50cccc => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:56:27.746679 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=20 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:27.747605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:27.751722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:27.752287 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:27.758375 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:27.761532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:27.761532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:27.761532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:27.786674 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:56:28.159496 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d1396b26-53b9-42b9-9473-65c4009b2736 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 204 len: 0 microversion: 2.1 time: 0.414239 May 18 22:56:28.160121 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 575/1157] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:56:27 2022] DELETE /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:56:28.170259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:28.170959 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:28.177372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:28.177819 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:28.178646 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:28.179082 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:28.309739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:56:28.317238 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-8f014c5c-81e3-4b0a-9371-058d5ee1f034 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1514 microversion: 2.1 time: 0.152626 May 18 22:56:28.317731 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 583/1158] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:28 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:29.334864 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:29.335462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:29.342530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:29.342973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:29.343731 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:29.344159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:29.479329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:56:29.487180 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-40c89bbb-f553-410d-9556-4bc4be05e6a8 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1514 microversion: 2.1 time: 0.156651 May 18 22:56:29.487746 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 576/1159] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:29 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:30.505144 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:30.505728 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:30.512324 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:30.516608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:30.516608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:30.516608 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:30.699830 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-d1944ff6-992e-466e-857a-aebf23c88f56 req-d17f4db8-c518-404e-96be-50c838d77309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1201fd1-d9b5-41c8-9260-3d53bde4b40c", "name": "network-vif-deleted", "tag": "5eeeb37c-5db5-47d3-9217-eac8b553b46c"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:56:30.708177 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-d1944ff6-992e-466e-857a-aebf23c88f56 req-d17f4db8-c518-404e-96be-50c838d77309 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:30.708623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-d1944ff6-992e-466e-857a-aebf23c88f56 req-d17f4db8-c518-404e-96be-50c838d77309 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:30.721587 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-d1944ff6-992e-466e-857a-aebf23c88f56 req-d17f4db8-c518-404e-96be-50c838d77309 service nova] Creating event network-vif-deleted:5eeeb37c-5db5-47d3-9217-eac8b553b46c for instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c on hv-cinder-83800 May 18 22:56:30.726926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f1e79cafd00439d859a736333d0caba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3bdd150da9d4f109717fbd4a46b477e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:56:30.727093 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-d1944ff6-992e-466e-857a-aebf23c88f56 req-d17f4db8-c518-404e-96be-50c838d77309 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031504 May 18 22:56:30.727668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 577/1160] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:56:30.735260 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f4db60f0-8cc6-4213-bfeb-8ee38189f20d tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 200 len: 1514 microversion: 2.1 time: 0.233902 May 18 22:56:30.735826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 584/1161] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:30 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:56:31.753200 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:31.753807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] [instance: d1201fd1-d9b5-41c8-9260-3d53bde4b40c] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:31.760550 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:31.761678 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:31.762516 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:31.762946 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:31.778579 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] HTTP exception thrown: Instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c could not be found. May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Request method failure captured: May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c HTTP/1.1 May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXkfCEvgnOW5wOvHwlHSI7-3FeF0EMgYW4P3FnOcGTvrDbPNzgNJl8nhCZ3rBYikwlV1JGFzkMqnMq9Y8pYdOFap6h3vuqZimv918k8IE4F5A4Ea5AgvH0UaxdwkwiEuypqAOV1rQ71wMl8QJf4LvdGLsoXtoBoDTbVuj6KaT3Ul6Wk May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: f3bdd150da9d4f109717fbd4a46b477e May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1813128956 May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:56:31.780181 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3bdd150da9d4f109717fbd4a46b477e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3bdd150da9d4f109717fbd4a46b477e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3bdd150da9d4f109717fbd4a46b477e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3bdd150da9d4f109717fbd4a46b477e"}]}] May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-VolumesSnapshotTestJSON-1813128956 May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: f3bdd150da9d4f109717fbd4a46b477e May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1813128956 May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-VolumesSnapshotTestJSON-1813128956-project May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 4f1e79cafd00439d859a736333d0caba May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-VolumesSnapshotTestJSON-1813128956-project May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c could not be found. May 18 22:56:31.781968 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'd1201fd1-d9b5-41c8-9260-3d53bde4b40c'} May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c could not be found. May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:56:31.782912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c could not be found. May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c could not be found. May 18 22:56:31.784541 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:56:31.786271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] Returning 404 to user: Instance d1201fd1-d9b5-41c8-9260-3d53bde4b40c could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:56:31.786271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-8058c61e-aaa6-4a5a-9548-74f22a95eac9 tempest-VolumesSnapshotTestJSON-1813128956 tempest-VolumesSnapshotTestJSON-1813128956-project] 10.222.0.70 "GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c" status: 404 len: 111 microversion: 2.1 time: 0.032688 May 18 22:56:31.786271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 578/1162] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:56:31 2022] GET /compute/v2.1/servers/d1201fd1-d9b5-41c8-9260-3d53bde4b40c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:56:51.136499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:56:51.137528 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:51.140277 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:51.140934 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:51.145648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:51.146138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:51.146906 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:51.147338 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:51.171418 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7a4cac59-f6c3-4869-97fa-faf1c5d5d41d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/ips" status: 200 len: 146 microversion: 2.1 time: 0.038747 May 18 22:56:51.172216 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 585/1163] 10.222.0.70 () {58 vars in 1247 bytes} [Wed May 18 22:56:51 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:56:53.802732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a8aa02-bdba-44e3-b194-ece8a4cd813c"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:56:53.803788 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:56:53.806329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:53.806983 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:56:53.812518 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:53.812960 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:53.813715 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:56:53.814193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:56:54.568057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f6af0cf2-55c4-435b-b3ab-2fac4116873e tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769186 May 18 22:56:54.568666 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 579/1164] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:56:53 2022] POST /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:02.072738 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:02.073711 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:02.081274 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:02.081730 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:02.082534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:02.082976 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:02.112377 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f4a4491c-bd52-4aa0-a6cd-d442950c3d9b tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 May 18 22:57:02.112943 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 586/1165] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:57:02 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:02.123863 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:02.124445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:02.131672 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:02.138611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:02.138611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:02.138611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:02.161962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e6a45ec5-5c78-4ad5-a4a3-c181a4b2e3e7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/c7a8aa02-bdba-44e3-b194-ece8a4cd813c" status: 200 len: 194 microversion: 2.1 time: 0.042816 May 18 22:57:02.162601 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 580/1166] 10.222.0.70 () {58 vars in 1412 bytes} [Wed May 18 22:57:02 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/c7a8aa02-bdba-44e3-b194-ece8a4cd813c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:04.888289 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f82da01-7d76-4168-8093-95dcb236971d"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:04.889294 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:04.896770 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:04.897415 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:04.898456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:04.899116 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:06.022639 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2b38f2eb-e02f-48b4-b0de-508f6c7dbe61 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "POST /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.137961 May 18 22:57:06.052025 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 587/1167] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:57:04 2022] POST /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:10.508866 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:57:10.509712 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 22:57:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 22:57:14.688542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:14.689569 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:14.700642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=4 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:14.702364 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:14.709759 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:14.715424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:14.715424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:14.715424 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:14.760050 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-18d99d20-1edb-4fbd-bb54-70473bfea7f2 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.076307 May 18 22:57:14.763800 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 581/1168] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:57:14 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:14.901352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:14.911013 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:14.911941 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:14.923124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:14.923964 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:14.925030 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:14.925691 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:14.966624 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-307d0fe5-d086-446a-b756-74adc5004d0c tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/c7a8aa02-bdba-44e3-b194-ece8a4cd813c" status: 200 len: 194 microversion: 2.1 time: 0.066568 May 18 22:57:14.972725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 588/1169] 10.222.0.70 () {58 vars in 1412 bytes} [Wed May 18 22:57:14 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/c7a8aa02-bdba-44e3-b194-ece8a4cd813c => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:14.981860 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:14.982600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:14.990292 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:14.990733 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:14.991772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:14.992384 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:15.096857 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lazy-loading 'services' on Instance uuid bf5f84ab-5397-4ccd-81d3-679188165067 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:57:15.357485 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f97b3612-4226-45dc-a186-70e7a108e369 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/c7a8aa02-bdba-44e3-b194-ece8a4cd813c" status: 202 len: 0 microversion: 2.1 time: 0.380692 May 18 22:57:15.358723 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 582/1170] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:57:14 2022] DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/c7a8aa02-bdba-44e3-b194-ece8a4cd813c => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:57:17.622708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:17.622708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:17.622708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:17.622708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:17.624970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:17.624970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:17.642617 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-630f0d49-177a-4e67-97cd-20ba3c105fb7 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/3f82da01-7d76-4168-8093-95dcb236971d" status: 200 len: 194 microversion: 2.1 time: 0.043359 May 18 22:57:17.643210 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 589/1171] 10.222.0.70 () {58 vars in 1412 bytes} [Wed May 18 22:57:17 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/3f82da01-7d76-4168-8093-95dcb236971d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:17.653832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:17.654450 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:17.661284 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:17.661791 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:17.662643 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:17.663158 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:17.768005 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lazy-loading 'services' on Instance uuid bf5f84ab-5397-4ccd-81d3-679188165067 {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:57:17.963485 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-75a75a2a-0cfd-442e-bd87-6ecbcb68efdf tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/3f82da01-7d76-4168-8093-95dcb236971d" status: 202 len: 0 microversion: 2.1 time: 0.314090 May 18 22:57:17.964088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 583/1172] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 22:57:17 2022] DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments/3f82da01-7d76-4168-8093-95dcb236971d => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:57:19.152407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:19.154083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:19.161957 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.162502 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.163335 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.163885 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.198746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2ee2a9bb-9ae8-41ea-b8b4-63fe7aced30f tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050245 May 18 22:57:19.199630 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 590/1173] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:57:19 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 22:57:19.325036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:19.327013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:19.334301 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.334753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.335568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.336000 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.368706 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-43512e3f-8911-4392-bb1d-8e324af8f1c3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049034 May 18 22:57:19.369270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 584/1174] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 22:57:19 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 22:57:19.434602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:19.435314 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:19.441616 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.442077 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.443064 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.443655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.473077 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:57:19.769968 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-ff557099-52f3-4ac3-9fae-e9f11040bc90 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 204 len: 0 microversion: 2.1 time: 0.338974 May 18 22:57:19.771192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 591/1175] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:57:19 2022] DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:57:19.779174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:19.780085 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:19.789384 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.790271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.791305 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:19.791919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:19.933805 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:19.942342 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-6aa3e4f3-db31-4c4a-803f-3f5b9460a3f0 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1674 microversion: 2.1 time: 0.166935 May 18 22:57:19.954679 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 585/1176] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:19 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:20.963273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:20.963979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:20.971250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:20.971691 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:20.972444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:20.972952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:21.124952 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:21.133484 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-238ee375-18c3-4928-a4fa-0ee2342900a6 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1674 microversion: 2.1 time: 0.174589 May 18 22:57:21.134296 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 592/1177] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:20 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:22.151829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:22.153035 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:22.160411 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:22.160949 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:22.161814 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:22.162451 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:22.380807 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:22.390221 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5d0322a0-6b30-4b46-b4c7-b9e31f8e10e3 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1674 microversion: 2.1 time: 0.242571 May 18 22:57:22.392257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 586/1178] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:22 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:23.113358 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-7a6172ea-521f-48de-b1bf-2c0ae09c66b1 req-e809fab5-6d40-4026-9f5f-c7bb23596109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5f84ab-5397-4ccd-81d3-679188165067", "name": "network-vif-deleted", "tag": "baf6c80c-9108-4eaf-a0c0-47d115e3d88f"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:23.130511 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-7a6172ea-521f-48de-b1bf-2c0ae09c66b1 req-e809fab5-6d40-4026-9f5f-c7bb23596109 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:23.130960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-7a6172ea-521f-48de-b1bf-2c0ae09c66b1 req-e809fab5-6d40-4026-9f5f-c7bb23596109 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:23.152926 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-7a6172ea-521f-48de-b1bf-2c0ae09c66b1 req-e809fab5-6d40-4026-9f5f-c7bb23596109 service nova] Creating event network-vif-deleted:baf6c80c-9108-4eaf-a0c0-47d115e3d88f for instance bf5f84ab-5397-4ccd-81d3-679188165067 on hv-cinder-83800 May 18 22:57:23.163569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-7a6172ea-521f-48de-b1bf-2c0ae09c66b1 req-e809fab5-6d40-4026-9f5f-c7bb23596109 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053739 May 18 22:57:23.164896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 593/1179] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:23.408809 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:23.409387 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:23.424566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:23.424566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:23.424566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:23.424566 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:23.499276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:23.509537 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a32aa5d9-d822-4812-b95e-c4560a0a779d tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1322 microversion: 2.1 time: 0.105136 May 18 22:57:23.510165 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 587/1180] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:23 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1322 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:24.529956 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:24.530793 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:24.538079 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:24.538623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:24.539593 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:24.540099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:24.575977 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:24.576417 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:24.576855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lazy-loading 'fault' on Instance uuid bf5f84ab-5397-4ccd-81d3-679188165067 {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 22:57:24.618807 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d0bc67048c4bbb893f2589800c4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89ab9bb65d8a44348faf97c7d19d8c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:24.626781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1d5f4d8a-e279-44c3-9055-bb6bc2eee244 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 200 len: 1327 microversion: 2.1 time: 0.102485 May 18 22:57:24.627367 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 594/1181] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:24 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:24.881360 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-50e23e90-4e93-4a5b-870d-3be7d01b5492 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Action: 'create', calling method: .version_select at 0x7f6cd92ac4c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1050671995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvJ/iO/LqgXaymlrShtBMjdou6OevhRa+2eB9Vq/O43/SoUjR5+VftcTRA/hatcLWiOIT+80ZvSkPUJOUvnmHPNexLmsNlzYdPsZ2B739kk8LsM+9FWBVutLGk0uJsisg=="}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:24.895743 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-50e23e90-4e93-4a5b-870d-3be7d01b5492 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Getting quotas for project d6448a906a594b6183ad55b7c49b24ff. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:57:24.899521 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-50e23e90-4e93-4a5b-870d-3be7d01b5492 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Getting quotas for user 9360bc198e484dd0bdcd9239f4510b0a and project d6448a906a594b6183ad55b7c49b24ff. Resources: {'key_pairs'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:57:24.964606 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-50e23e90-4e93-4a5b-870d-3be7d01b5492 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.087059 May 18 22:57:24.965215 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 588/1182] 10.222.0.70 () {60 vars in 1158 bytes} [Wed May 18 22:57:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:25.015172 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-508927001", "imageRef": "0613558f-d629-420e-822a-73865e35930f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1050671995", "networks": [{"uuid": "12ced659-e9e7-4e4d-acc0-3a4bd251a2f9"}]}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:25.064967 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.network.neutron [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] validate_networks() for [('12ced659-e9e7-4e4d-acc0-3a4bd251a2f9', None, None, None, None, None)] {{(pid=124367) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:57:25.427444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Flavor limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:57:25.427939 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Image limits 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:57:25.428418 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Flavor pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:57:25.428884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Image pref 0:0:0 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:57:25.429296 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.virt.hardware [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124367) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:57:25.439442 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:25.439953 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:25.440703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:25.444407 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:25.458724 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Getting quotas for project d6448a906a594b6183ad55b7c49b24ff. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:57:25.462692 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.quota [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Getting quotas for user 9360bc198e484dd0bdcd9239f4510b0a and project d6448a906a594b6183ad55b7c49b24ff. Resources: {'cores', 'ram', 'instances'} {{(pid=124367) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:57:25.474299 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Going to run 1 instances... {{(pid=124367) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:57:25.476508 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0613558f-d629-420e-822a-73865e35930f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124367) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:57:25.626970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a2526800-ae7e-4912-8273-2b59c02e0ab5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615540 May 18 22:57:25.627955 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 595/1183] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:57:25.637481 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-3c1ed152-3f9a-4175-92ec-1923ae38fc64 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:25.638116 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-3c1ed152-3f9a-4175-92ec-1923ae38fc64 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:25.645470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:25.646369 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:25.652930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:25.653386 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:25.654268 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:25.654726 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:25.675300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] HTTP exception thrown: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Request method failure captured: May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 HTTP/1.1 May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXgIxF6RmBSboOLuO0gFEPXWHSPhjc00EQ0ys0t4TjPdPMm0a7r3qRwnDI3A2c43gRECVMlMbfr2_FhWrJO2gKS9lVIqxG2BlCIQRGPpwuzPjb25OqcysPPfJRcpQTtXAOsqlnP8lI06yaz8EKbegOspfJACPGf1fPWAJEBtnTPH9Fw May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:57:25.676982 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89ab9bb65d8a44348faf97c7d19d8c84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89ab9bb65d8a44348faf97c7d19d8c84"}]}] May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 18d0bc67048c4bbb893f2589800c4535 May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:25.679001 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'bf5f84ab-5397-4ccd-81d3-679188165067'} May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:57:25.680725 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:25.686195 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:25.688234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Returning 404 to user: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:57:25.688234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5e884690-c0ac-4284-933b-90c6ec25e268 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 404 len: 111 microversion: 2.1 time: 0.039909 May 18 22:57:25.688234 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 596/1184] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:25 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:57:25.692924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-3842bb4c-a01d-466d-ad6d-6e4f596ab548 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '.version_select at 0x7f6cd8ffa5e0>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:25.714255 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-3c1ed152-3f9a-4175-92ec-1923ae38fc64 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:25.725887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-3c1ed152-3f9a-4175-92ec-1923ae38fc64 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1258 microversion: 2.1 time: 0.092135 May 18 22:57:25.726506 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 589/1185] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:25 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:25.896685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-3842bb4c-a01d-466d-ad6d-6e4f596ab548 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116528282" status: 202 len: 0 microversion: 2.1 time: 0.209932 May 18 22:57:25.897372 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 597/1186] 10.222.0.70 () {58 vars in 1220 bytes} [Wed May 18 22:57:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1116528282 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:57:26.744226 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:26.744961 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:26.752349 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:26.752794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:26.753556 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:26.753986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:26.818616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:26.825202 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-a684360e-ea3d-4ebf-ad64-6d02f18aa3a9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1262 microversion: 2.1 time: 0.085097 May 18 22:57:26.825779 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 590/1187] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:26 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:27.843381 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:27.843996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:27.851903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:27.852345 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:27.853107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:27.853719 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:27.936766 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:27.948046 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-2d751299-7e7d-495e-ae57-049f9bcc32a4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1318 microversion: 2.1 time: 0.108926 May 18 22:57:27.959641 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 598/1188] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:27 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1318 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:28.973036 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:28.975019 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:28.982476 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:28.982476 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:28.983642 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:28.984257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:29.157908 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:29.168127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-72946af5-e265-40e1-af57-63bd3bc69f56 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.204733 May 18 22:57:29.169251 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 591/1189] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:28 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:29.259296 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:29.259867 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:29.266423 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:29.267444 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:29.268207 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:29.268634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:29.284343 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] HTTP exception thrown: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Request method failure captured: May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 HTTP/1.1 May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXgIxF6RmBSboOLuO0gFEPXWHSPhjc00EQ0ys0t4TjPdPMm0a7r3qRwnDI3A2c43gRECVMlMbfr2_FhWrJO2gKS9lVIqxG2BlCIQRGPpwuzPjb25OqcysPPfJRcpQTtXAOsqlnP8lI06yaz8EKbegOspfJACPGf1fPWAJEBtnTPH9Fw May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:57:29.286392 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89ab9bb65d8a44348faf97c7d19d8c84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89ab9bb65d8a44348faf97c7d19d8c84"}]}] May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 18d0bc67048c4bbb893f2589800c4535 May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.288339 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'bf5f84ab-5397-4ccd-81d3-679188165067'} May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:57:29.289510 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.291474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:29.293978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Returning 404 to user: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:57:29.296145 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fd9a221a-07d1-43c0-acf6-2f9e6d5ec838 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 404 len: 111 microversion: 2.1 time: 0.040606 May 18 22:57:29.296708 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 599/1190] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:57:29 2022] DELETE /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:57:29.304925 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:29.305542 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bf5f84ab-5397-4ccd-81d3-679188165067] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:29.312763 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:29.313223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:29.314564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:29.315010 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:29.332172 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] HTTP exception thrown: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Request method failure captured: May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 HTTP/1.1 May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXgIxF6RmBSboOLuO0gFEPXWHSPhjc00EQ0ys0t4TjPdPMm0a7r3qRwnDI3A2c43gRECVMlMbfr2_FhWrJO2gKS9lVIqxG2BlCIQRGPpwuzPjb25OqcysPPfJRcpQTtXAOsqlnP8lI06yaz8EKbegOspfJACPGf1fPWAJEBtnTPH9Fw May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:57:29.333802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89ab9bb65d8a44348faf97c7d19d8c84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89ab9bb65d8a44348faf97c7d19d8c84"}]}] May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 18d0bc67048c4bbb893f2589800c4535 May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.335319 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'bf5f84ab-5397-4ccd-81d3-679188165067'} May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:57:29.339279 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. May 18 22:57:29.340577 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:29.342246 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Returning 404 to user: Instance bf5f84ab-5397-4ccd-81d3-679188165067 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:57:29.342246 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-998c15e5-c300-4583-8f85-a9b50add3a82 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067" status: 404 len: 111 microversion: 2.1 time: 0.034230 May 18 22:57:29.342246 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 592/1191] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:29 2022] GET /compute/v2.1/servers/bf5f84ab-5397-4ccd-81d3-679188165067 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:57:30.186683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:30.187296 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:30.193976 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:30.194447 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:30.195198 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:30.195631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:30.355103 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:30.366285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d07e02af-3a2a-4e07-ae8d-a71c356f513b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.183192 May 18 22:57:30.367357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 600/1192] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:30 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:30.639183 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:30.639750 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:30.646306 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:30.646760 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:30.647532 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:30.647962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:30.661589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] HTTP exception thrown: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Request method failure captured: May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 HTTP/1.1 May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXgIxF6RmBSboOLuO0gFEPXWHSPhjc00EQ0ys0t4TjPdPMm0a7r3qRwnDI3A2c43gRECVMlMbfr2_FhWrJO2gKS9lVIqxG2BlCIQRGPpwuzPjb25OqcysPPfJRcpQTtXAOsqlnP8lI06yaz8EKbegOspfJACPGf1fPWAJEBtnTPH9Fw May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:57:30.663154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89ab9bb65d8a44348faf97c7d19d8c84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89ab9bb65d8a44348faf97c7d19d8c84"}]}] May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 18d0bc67048c4bbb893f2589800c4535 May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.665001 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'bb83799d-978a-401d-9194-46c104e85cf9'} May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:57:30.666441 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.668163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:57:30.669910 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Returning 404 to user: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:57:30.669910 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0327091c-f9e0-437a-869f-18029a002bfb tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 404 len: 111 microversion: 2.1 time: 0.029441 May 18 22:57:30.669910 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 593/1193] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:57:30 2022] DELETE /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:57:30.673764 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:30.674396 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] [instance: bb83799d-978a-401d-9194-46c104e85cf9] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:30.680400 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:30.680826 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:30.681588 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:30.682042 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:30.696124 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] HTTP exception thrown: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Request method failure captured: May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 HTTP/1.1 May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXgIxF6RmBSboOLuO0gFEPXWHSPhjc00EQ0ys0t4TjPdPMm0a7r3qRwnDI3A2c43gRECVMlMbfr2_FhWrJO2gKS9lVIqxG2BlCIQRGPpwuzPjb25OqcysPPfJRcpQTtXAOsqlnP8lI06yaz8EKbegOspfJACPGf1fPWAJEBtnTPH9Fw May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:57:30.697656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_89ab9bb65d8a44348faf97c7d19d8c84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/89ab9bb65d8a44348faf97c7d19d8c84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/89ab9bb65d8a44348faf97c7d19d8c84"}]}] May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 89ab9bb65d8a44348faf97c7d19d8c84 May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735976981 May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 18d0bc67048c4bbb893f2589800c4535 May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-AttachVolumeTestJSON-735976981-project May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.699353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'bb83799d-978a-401d-9194-46c104e85cf9'} May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:57:30.700749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. May 18 22:57:30.702232 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:57:30.703561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] Returning 404 to user: Instance bb83799d-978a-401d-9194-46c104e85cf9 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:57:30.703561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dc85ac92-10cc-4b7e-afab-682c8453a371 tempest-AttachVolumeTestJSON-735976981 tempest-AttachVolumeTestJSON-735976981-project] 10.222.0.70 "GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9" status: 404 len: 111 microversion: 2.1 time: 0.029632 May 18 22:57:30.703561 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 601/1194] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:30 2022] GET /compute/v2.1/servers/bb83799d-978a-401d-9194-46c104e85cf9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:57:31.386530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:31.387605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:31.395802 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:31.396937 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:31.398381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:31.399143 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:31.553083 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:31.561677 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0a24a80b-2ff8-4e45-ab1b-6cea6b4f6d02 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.180177 May 18 22:57:31.573077 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 594/1195] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:31 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:32.580168 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:32.580781 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:32.588490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:32.589519 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:32.599210 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:32.599978 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:32.965543 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:32.969463 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:32.974274 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d70e02ec-9267-4d3b-8552-320b40ab635f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.397991 May 18 22:57:32.975170 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 602/1196] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:32 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:33.991216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:33.991932 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:34.002975 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:34.004714 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:34.005810 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:34.006596 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:34.561271 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:34.570845 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-723cf3f2-064b-4373-b688-72d79863c25e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.583369 May 18 22:57:34.571431 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 595/1197] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:33 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:35.591541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:35.592451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:35.595323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:35.596247 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=6 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:35.621499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:35.621499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:35.621499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:35.621499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:35.785881 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:35.797465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a0c5d265-c064-4bd0-b10b-2a107f247015 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.212672 May 18 22:57:35.799465 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 603/1198] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:35 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:36.816057 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:36.816589 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:36.819726 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:36.824514 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:36.824952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:36.825704 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:36.826163 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:36.967308 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:36.972805 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-043d906d-5344-491c-ae35-183056470133 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.160498 May 18 22:57:36.973626 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 596/1199] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:36 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:37.991460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:37.992084 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:38.000352 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:38.001672 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:38.002738 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:38.003180 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:38.155541 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:38.163091 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7f378276-680f-4779-ba89-0210e05a9124 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.175490 May 18 22:57:38.163660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 604/1200] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:37 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:39.180722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:39.181332 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:39.188935 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:39.189416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:39.190220 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:39.190658 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:39.325108 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:39.333406 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ace6ef5b-e1ea-4f10-986f-f0be52fc1b3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.156562 May 18 22:57:39.333981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 597/1201] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:39 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:40.319207 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-c9dc9417-6e13-4f31-bed1-1562b93e31c1 req-8426686e-628d-4294-b551-099a96ba917f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:40.327500 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c9dc9417-6e13-4f31-bed1-1562b93e31c1 req-8426686e-628d-4294-b551-099a96ba917f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:40.327946 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c9dc9417-6e13-4f31-bed1-1562b93e31c1 req-8426686e-628d-4294-b551-099a96ba917f service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:40.339295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-c9dc9417-6e13-4f31-bed1-1562b93e31c1 req-8426686e-628d-4294-b551-099a96ba917f service nova] Creating event network-changed:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 22:57:40.348746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-c9dc9417-6e13-4f31-bed1-1562b93e31c1 req-8426686e-628d-4294-b551-099a96ba917f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176379 May 18 22:57:40.349652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 605/1202] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:40.351952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:40.352892 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:40.359699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:40.360706 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:40.362107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:40.362549 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:40.585416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:40.592907 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-08794346-9b13-4ebd-8d37-179eaaf9eeec tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.245696 May 18 22:57:40.593731 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 598/1203] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:40 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:57:41.614644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:41.614644 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:41.620648 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:41.621093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:41.621854 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:41.622320 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:41.760521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:41.769040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c2640df3-e752-4373-ae3f-7a3d3814354f tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.161129 May 18 22:57:41.769694 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 606/1204] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:41 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:42.785805 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:42.786381 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:42.793173 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:42.793655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:42.794445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:42.794879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:42.812947 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:42.923248 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:42.932306 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5fc0d87f-5e42-4b4c-9107-0488016edfc3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.151038 May 18 22:57:42.932887 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 599/1205] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:42 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:43.949749 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:43.950996 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:43.958472 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:43.959329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:43.960335 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:43.960942 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:44.180684 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:44.188326 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-24990995-17d3-4dae-9220-22543a2e0bff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.243330 May 18 22:57:44.189634 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 607/1206] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:43 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:45.205796 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:45.206520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:45.210038 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:45.215469 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:45.216013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:45.216948 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:45.217449 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:45.345872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:45.356318 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e6781ad6-16f3-4e5c-bbb5-1a299c930a14 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.155338 May 18 22:57:45.368031 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 600/1207] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:45 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:45.595584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-42a0dc4b-4509-48b7-a2e9-4ae5717b554f req-c791b77f-6374-47c8-b47a-4ee9ae1440ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "name": "network-vif-plugged", "status": "completed", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:45.599142 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:45.604259 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-42a0dc4b-4509-48b7-a2e9-4ae5717b554f req-c791b77f-6374-47c8-b47a-4ee9ae1440ab service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:45.604705 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-42a0dc4b-4509-48b7-a2e9-4ae5717b554f req-c791b77f-6374-47c8-b47a-4ee9ae1440ab service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:45.616584 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-42a0dc4b-4509-48b7-a2e9-4ae5717b554f req-c791b77f-6374-47c8-b47a-4ee9ae1440ab service nova] Creating event network-vif-plugged:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 22:57:45.621480 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-42a0dc4b-4509-48b7-a2e9-4ae5717b554f req-c791b77f-6374-47c8-b47a-4ee9ae1440ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151104 May 18 22:57:45.622107 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 608/1208] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:46.372655 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:46.373339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:46.380298 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:46.380736 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:46.381493 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:46.381923 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:46.514482 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:46.522621 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-232681ca-abb5-47cb-a533-9d68a01dc916 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1358 microversion: 2.1 time: 0.153861 May 18 22:57:46.523195 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 601/1209] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:46 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:47.540173 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:47.541144 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:47.548989 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:47.549498 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:47.550240 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:47.550675 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:47.683683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:47.691466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-b6127462-10bf-4dd5-981b-5be2a29965cc tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1548 microversion: 2.1 time: 0.155453 May 18 22:57:47.692042 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 609/1210] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:47 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:47.709283 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:47.709936 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:47.716474 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:47.717442 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:47.718247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:47.718843 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:47.887068 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:47.904708 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ca5e9fd5-5874-4542-a703-2f93e35f53b9 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1548 microversion: 2.1 time: 0.200511 May 18 22:57:47.904872 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 602/1211] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:47 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:47.921750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:47.925776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:47.926656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Searching by: {'deleted': False, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff'} {{(pid=124367) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 18 22:57:47.933285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:47.933733 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:47.934569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:47.934998 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:48.027979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.multi_cell_list [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124367) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 18 22:57:48.129805 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-a4289d01-9e39-46dc-85c7-2cec8142378a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212739 May 18 22:57:48.130351 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 610/1212] 10.222.0.70 () {58 vars in 1124 bytes} [Wed May 18 22:57:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:48.140393 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:48.140999 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:48.147886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:48.148350 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:48.149091 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:48.149576 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:48.367187 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:48.374732 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-0919e3d5-56d4-40f8-86eb-a22d5fa8d8e4 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1548 microversion: 2.1 time: 0.238247 May 18 22:57:48.375308 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 603/1213] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:48 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1548 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:57:50.171609 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "555d3609-bc79-4167-a623-97916c3c02d9"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:57:50.172739 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:50.181806 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:50.182285 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:50.183040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:50.183473 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:50.931243 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f33e76fd-9186-4ac6-a303-c5626aeef656 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763465 May 18 22:57:50.936460 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 611/1214] 10.222.0.70 () {60 vars in 1322 bytes} [Wed May 18 22:57:50 2022] POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:57:58.479278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:57:58.480414 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:57:58.482460 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=7 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:58.483123 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=26 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:57:58.487928 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:58.488376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:58.489137 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:57:58.489576 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:57:58.619653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:57:58.628164 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e3059b12-1c13-4d5b-850a-37f180294b7c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1594 microversion: 2.1 time: 0.152650 May 18 22:57:58.628747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 604/1215] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:57:58 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:01.072631 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:01.073824 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=7 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:01.074490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:01.078604 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-914fcef3-8c0f-4feb-9f08-5d8b5f85bef5 req-e81452cd-19df-4f03-a6a6-02eee3e2f8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:01.096525 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-914fcef3-8c0f-4feb-9f08-5d8b5f85bef5 req-e81452cd-19df-4f03-a6a6-02eee3e2f8d5 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:01.096525 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-914fcef3-8c0f-4feb-9f08-5d8b5f85bef5 req-e81452cd-19df-4f03-a6a6-02eee3e2f8d5 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:01.107653 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-914fcef3-8c0f-4feb-9f08-5d8b5f85bef5 req-e81452cd-19df-4f03-a6a6-02eee3e2f8d5 service nova] Creating event network-changed:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 22:58:01.114433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-914fcef3-8c0f-4feb-9f08-5d8b5f85bef5 req-e81452cd-19df-4f03-a6a6-02eee3e2f8d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042552 May 18 22:58:01.115880 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 612/1216] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:03.763402 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1936310504"}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:03.763928 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:03.770108 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:03.770560 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:03.771308 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:03.771739 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:03.905275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.network.security_group_api [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Adding security group afc41bdb-26ff-4d5d-8cfb-ac29d91decf4 to port 05f877a6-d013-42a7-9c40-0e319d309c38 May 18 22:58:04.389545 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e80d929c-1339-4585-bcc2-91fc1c329d69 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/action" status: 202 len: 0 microversion: 2.1 time: 0.629947 May 18 22:58:04.390184 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 605/1217] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:58:03 2022] POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:58:04.401617 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-62cb4cd3-a975-417a-bdd2-54f0ff4d69d2 req-3c44745d-e2e6-47ff-be7f-39a57f14c33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:04.405864 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:04.406633 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:04.413364 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:04.413770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-62cb4cd3-a975-417a-bdd2-54f0ff4d69d2 req-3c44745d-e2e6-47ff-be7f-39a57f14c33e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:04.413911 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:04.414621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:04.414768 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-62cb4cd3-a975-417a-bdd2-54f0ff4d69d2 req-3c44745d-e2e6-47ff-be7f-39a57f14c33e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:04.415055 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:04.432527 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-62cb4cd3-a975-417a-bdd2-54f0ff4d69d2 req-3c44745d-e2e6-47ff-be7f-39a57f14c33e service nova] Creating event network-changed:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 22:58:04.439662 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-62cb4cd3-a975-417a-bdd2-54f0ff4d69d2 req-3c44745d-e2e6-47ff-be7f-39a57f14c33e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042266 May 18 22:58:04.440511 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 606/1218] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:04.698656 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:04.708435 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-dbcb2ce2-d6ed-4c56-8e8b-6cee1b9080c3 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1759 microversion: 2.1 time: 0.311789 May 18 22:58:04.709188 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 613/1219] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:04 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1759 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:06.434592 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1897719177", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "networks": [{"uuid": "898d33b1-5275-4be9-96ec-c94be43ebe93"}]}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:06.485064 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] validate_networks() for [('898d33b1-5275-4be9-96ec-c94be43ebe93', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:58:06.844278 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:58:06.844767 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:58:06.845237 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:58:06.845640 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:58:06.846070 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:58:06.855012 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:06.855390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:06.856176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:06.856600 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:06.873147 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Getting quotas for project 5b2b243ed5194c57a9513438ed308d2f. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:58:06.877797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Getting quotas for user 1cbd496c75b84fffa96cbbf929fc5f5a and project 5b2b243ed5194c57a9513438ed308d2f. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:58:06.888418 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:58:06.890777 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:58:07.200452 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-9dfed49b-a6e4-48c8-9a62-9162e2efc153 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770457 May 18 22:58:07.201222 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 607/1220] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:58:07.211907 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-67772bcd-77b0-4e19-adb3-3bc881ca89ca tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:07.212521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-67772bcd-77b0-4e19-adb3-3bc881ca89ca tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:07.276456 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-67772bcd-77b0-4e19-adb3-3bc881ca89ca tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:07.286050 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-67772bcd-77b0-4e19-adb3-3bc881ca89ca tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1214 microversion: 2.1 time: 0.077906 May 18 22:58:07.286647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 614/1221] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:07 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:08.303379 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:08.303987 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:08.312265 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:08.312711 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:08.313471 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:08.313899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:08.374659 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:08.383098 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-299c3540-3380-45f4-b214-773afebf3137 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1218 microversion: 2.1 time: 0.083667 May 18 22:58:08.383668 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 608/1222] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:08 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:09.399785 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:09.401179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:09.410896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:09.410896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:09.411134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:09.411398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:09.507430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:09.515273 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-fe9ab57f-80a6-4cfc-a67b-20305c2ca799 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1274 microversion: 2.1 time: 0.119286 May 18 22:58:09.515865 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 615/1223] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:09 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:10.534965 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:10.535588 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:10.542457 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:10.542904 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:10.543710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:10.544140 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:10.748216 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:10.756033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-b09ee597-4577-450e-b2d7-1769b30af681 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.226847 May 18 22:58:10.756700 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 609/1224] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:10 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:11.001548 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-09c2d58d-f0d0-40c1-a803-bcef3db1d0ae req-52362499-dd88-4998-a9fa-0c369fd9c93e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e83523af-2d94-4ee2-bb73-fbbf157c3c36", "tag": "dff46bec-21f5-4641-a5bd-575a12bdf8dd"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:11.011385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-09c2d58d-f0d0-40c1-a803-bcef3db1d0ae req-52362499-dd88-4998-a9fa-0c369fd9c93e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:11.012040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-09c2d58d-f0d0-40c1-a803-bcef3db1d0ae req-52362499-dd88-4998-a9fa-0c369fd9c93e service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:11.025499 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-09c2d58d-f0d0-40c1-a803-bcef3db1d0ae req-52362499-dd88-4998-a9fa-0c369fd9c93e service nova] Creating event network-changed:dff46bec-21f5-4641-a5bd-575a12bdf8dd for instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 on hv-cinder-83800 May 18 22:58:11.030213 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-09c2d58d-f0d0-40c1-a803-bcef3db1d0ae req-52362499-dd88-4998-a9fa-0c369fd9c93e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032360 May 18 22:58:11.030798 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 616/1225] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:11.773568 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:11.774217 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:11.780715 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:11.781166 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:11.781927 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:11.782413 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:11.911083 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:11.918915 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-648f6dbd-7720-4027-b1c0-402f85a095fa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.149476 May 18 22:58:11.919489 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 610/1226] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:11 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:12.936332 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:12.937034 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:12.943449 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:12.943899 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:12.944661 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:12.945098 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:13.072323 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:13.079630 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-76f15372-f3df-4eb4-9ee4-cf7a0ce71ce0 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.147963 May 18 22:58:13.080260 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 617/1227] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:12 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:14.096366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:14.096972 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:14.103510 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:14.103956 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:14.104713 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:14.105144 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:14.238830 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:14.246276 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5dceb274-7fcd-485b-8253-59623893297f tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.153688 May 18 22:58:14.246853 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 611/1228] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:14 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:15.264250 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:15.264891 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:15.272114 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:15.272568 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:15.273329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:15.273765 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:15.404903 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:15.413130 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-41b8d884-3234-40bb-8df7-b97d38c820cc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.152792 May 18 22:58:15.413703 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 618/1229] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:15 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:15.714128 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-0a10488a-f7be-4b7e-a5e7-12d1350df689 req-0ec92f6a-2fc4-4c4f-9ce1-8ff7b596334a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83523af-2d94-4ee2-bb73-fbbf157c3c36", "name": "network-vif-plugged", "status": "completed", "tag": "dff46bec-21f5-4641-a5bd-575a12bdf8dd"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:15.723266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0a10488a-f7be-4b7e-a5e7-12d1350df689 req-0ec92f6a-2fc4-4c4f-9ce1-8ff7b596334a service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:15.723837 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-0a10488a-f7be-4b7e-a5e7-12d1350df689 req-0ec92f6a-2fc4-4c4f-9ce1-8ff7b596334a service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:15.734531 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-0a10488a-f7be-4b7e-a5e7-12d1350df689 req-0ec92f6a-2fc4-4c4f-9ce1-8ff7b596334a service nova] Creating event network-vif-plugged:dff46bec-21f5-4641-a5bd-575a12bdf8dd for instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 on hv-cinder-83800 May 18 22:58:15.739347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-0a10488a-f7be-4b7e-a5e7-12d1350df689 req-0ec92f6a-2fc4-4c4f-9ce1-8ff7b596334a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029042 May 18 22:58:15.740889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 612/1230] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:16.430884 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:16.431494 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:16.437865 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:16.438349 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:16.439106 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:16.439540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:16.570042 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:16.577515 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d012cdc0-7790-4dac-9fa7-bfe387d5e3f4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.150398 May 18 22:58:16.578039 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 619/1231] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:16 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:17.592334 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:17.593131 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:17.597762 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:17.598530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:17.604564 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:17.605025 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:17.605780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:17.606232 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:17.735985 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:17.743397 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-f7a09049-ec9d-40b6-b9d4-559b57261092 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1314 microversion: 2.1 time: 0.152430 May 18 22:58:17.743962 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 613/1232] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:17 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:18.760005 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:18.760602 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:18.762547 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:18.767746 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:18.771678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:18.771678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:18.771678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:18.899779 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:18.907614 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e68b2174-6c67-46ae-b4ce-f5091a9e28ee tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1499 microversion: 2.1 time: 0.151430 May 18 22:58:18.908176 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 620/1233] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:18 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:19.757338 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:19.757852 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:19.764257 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:19.764699 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:19.765450 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:19.765879 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:19.793134 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Going to try to terminate instance {{(pid=124366) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:58:20.054722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e1bf86cb-d6bb-4952-bcb7-f40a5352d3c8 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 204 len: 0 microversion: 2.1 time: 0.300773 May 18 22:58:20.055247 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 614/1234] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:58:19 2022] DELETE /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 22:58:20.063422 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:20.064069 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:20.072281 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:20.072729 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:20.073555 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:20.073986 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:20.208888 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:20.216408 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1070bde8-97ab-41d5-9a0b-3188a5af91e9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1505 microversion: 2.1 time: 0.156876 May 18 22:58:20.216979 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 621/1235] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:20 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:21.234628 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:21.235321 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:21.242718 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:21.243159 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:21.243906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:21.244333 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:21.376623 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:21.384591 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-978f6202-1627-4278-914f-70fdb6ac0ca4 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1505 microversion: 2.1 time: 0.154235 May 18 22:58:21.385151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 615/1236] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:21 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:22.355233 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-380b4fba-d7c6-4c0f-92d9-eff963dbe76f req-5a3cbdf6-5b78-49af-a41b-5cb1de725657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e83523af-2d94-4ee2-bb73-fbbf157c3c36", "name": "network-vif-deleted", "tag": "dff46bec-21f5-4641-a5bd-575a12bdf8dd"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:22.364340 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-380b4fba-d7c6-4c0f-92d9-eff963dbe76f req-5a3cbdf6-5b78-49af-a41b-5cb1de725657 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:22.365848 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-380b4fba-d7c6-4c0f-92d9-eff963dbe76f req-5a3cbdf6-5b78-49af-a41b-5cb1de725657 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:22.375588 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-380b4fba-d7c6-4c0f-92d9-eff963dbe76f req-5a3cbdf6-5b78-49af-a41b-5cb1de725657 service nova] Creating event network-vif-deleted:dff46bec-21f5-4641-a5bd-575a12bdf8dd for instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 on hv-cinder-83800 May 18 22:58:22.380958 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-380b4fba-d7c6-4c0f-92d9-eff963dbe76f req-5a3cbdf6-5b78-49af-a41b-5cb1de725657 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029389 May 18 22:58:22.381550 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 622/1237] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 22:58:22.401799 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:22.402445 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:22.408966 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:22.409465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:22.410339 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:22.410979 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:22.479953 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:22.488725 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-89e4a666-7c78-47d8-ae32-4c9ba130d0dc tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 200 len: 1463 microversion: 2.1 time: 0.089967 May 18 22:58:22.489347 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 616/1238] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:22 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 1463 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:23.507353 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:23.508049 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: e83523af-2d94-4ee2-bb73-fbbf157c3c36] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:23.514414 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:23.514860 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:23.515615 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:23.516049 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:23.531521 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] HTTP exception thrown: Instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 could not be found. May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Request method failure captured: May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 HTTP/1.1 May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXn7uZPpGn6g_sHglss6sVd_J3OqmFmQqLNCBO0dODvcPld5FUZ75xHZTILT2zUT77myVIJU1XkASp2KVPOYToSvPCDPWSGQvUhxQZ07QA1mZCFTflzDz1YgyFHsweJvAfF2Jxffpww5BYp8fBVy84zaXxuBxx4rvxSq-JS9v4vmQO0 May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: 5b2b243ed5194c57a9513438ed308d2f May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-VolumesActionsTest-248597029 May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 22:58:23.533099 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2b243ed5194c57a9513438ed308d2f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2b243ed5194c57a9513438ed308d2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2b243ed5194c57a9513438ed308d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2b243ed5194c57a9513438ed308d2f"}]}] May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-VolumesActionsTest-248597029 May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: 5b2b243ed5194c57a9513438ed308d2f May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-VolumesActionsTest-248597029 May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-VolumesActionsTest-248597029-project May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 1cbd496c75b84fffa96cbbf929fc5f5a May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-VolumesActionsTest-248597029-project May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 could not be found. May 18 22:58:23.535174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': 'e83523af-2d94-4ee2-bb73-fbbf157c3c36'} May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 could not be found. May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:58:23.536402 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 could not be found. May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 could not be found. May 18 22:58:23.538697 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 22:58:23.540506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Returning 404 to user: Instance e83523af-2d94-4ee2-bb73-fbbf157c3c36 could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:58:23.540506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bea6266b-80ae-4bc4-88e3-cfe6ca62cbbb tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36" status: 404 len: 111 microversion: 2.1 time: 0.032453 May 18 22:58:23.540506 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 623/1239] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:23 2022] GET /compute/v2.1/servers/e83523af-2d94-4ee2-bb73-fbbf157c3c36 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:58:23.582597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1433810978", "imageRef": "dd7f4201-5433-4b93-8f49-d7b9aa9e68a1", "flavorRef": "452", "networks": [{"uuid": "898d33b1-5275-4be9-96ec-c94be43ebe93"}]}} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:23.633675 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.network.neutron [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] validate_networks() for [('898d33b1-5275-4be9-96ec-c94be43ebe93', None, None, None, None, None)] {{(pid=124366) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 22:58:24.231054 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Flavor limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 22:58:24.231477 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Image limits 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 22:58:24.231954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Flavor pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 22:58:24.232362 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Image pref 0:0:0 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 22:58:24.232772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.virt.hardware [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124366) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 22:58:24.242335 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:24.242786 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:24.243583 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:24.244027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:24.260322 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Getting quotas for project 5b2b243ed5194c57a9513438ed308d2f. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 22:58:24.264254 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.quota [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Getting quotas for user 1cbd496c75b84fffa96cbbf929fc5f5a and project 5b2b243ed5194c57a9513438ed308d2f. Resources: {'cores', 'ram', 'instances'} {{(pid=124366) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 22:58:24.275265 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Going to run 1 instances... {{(pid=124366) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 22:58:24.277510 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7f4201-5433-4b93-8f49-d7b9aa9e68a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124366) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 22:58:24.415597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-e2adc3d7-a244-4dd0-bae8-426f431bf6fd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837197 May 18 22:58:24.416355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 617/1240] 10.222.0.70 () {60 vars in 1146 bytes} [Wed May 18 22:58:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 22:58:24.427019 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-340939d6-b6d7-43b1-9445-6a5c155a35d6 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:24.427678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-340939d6-b6d7-43b1-9445-6a5c155a35d6 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:24.485291 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-340939d6-b6d7-43b1-9445-6a5c155a35d6 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:24.492573 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-340939d6-b6d7-43b1-9445-6a5c155a35d6 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1214 microversion: 2.1 time: 0.070002 May 18 22:58:24.493161 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 624/1241] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:24 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:25.510129 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:25.510737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:25.518154 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:25.518608 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:25.520239 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:25.520717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:25.582415 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:25.589839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-eb1761b7-e520-47a7-8889-b1caeeb121ed tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1210 microversion: 2.1 time: 0.083829 May 18 22:58:25.590465 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 618/1242] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:25 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:26.610093 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:26.610655 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:26.617931 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:26.618438 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:26.619192 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:26.619623 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:26.695702 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:26.703054 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-805cee4d-297d-4ec1-aa4f-6ba24324393e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1272 microversion: 2.1 time: 0.096802 May 18 22:58:26.703614 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 625/1243] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:26 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:27.720663 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:27.721370 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:27.728730 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:27.729259 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:27.730150 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:27.730594 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:27.883335 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:27.890028 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-80f2459d-45c6-4312-8500-2fa4a58751dd tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.173303 May 18 22:58:27.890598 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 619/1244] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:27 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:27.952560 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-283f2f82-def7-4f35-af54-4a361f3b63cb req-f9c401a2-4b31-4c75-9669-8c6ac8c01755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8515e2b-c87b-4e41-9a68-05c6b7f13cf2", "tag": "17f2bcce-9850-48d0-b4a3-025f3cd6500e"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:27.963132 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-283f2f82-def7-4f35-af54-4a361f3b63cb req-f9c401a2-4b31-4c75-9669-8c6ac8c01755 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:27.963709 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-283f2f82-def7-4f35-af54-4a361f3b63cb req-f9c401a2-4b31-4c75-9669-8c6ac8c01755 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:27.974635 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-283f2f82-def7-4f35-af54-4a361f3b63cb req-f9c401a2-4b31-4c75-9669-8c6ac8c01755 service nova] Creating event network-changed:17f2bcce-9850-48d0-b4a3-025f3cd6500e for instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 on hv-cinder-83800 May 18 22:58:27.979225 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-283f2f82-def7-4f35-af54-4a361f3b63cb req-f9c401a2-4b31-4c75-9669-8c6ac8c01755 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030409 May 18 22:58:27.979830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 626/1245] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:28.907067 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:28.907737 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:28.910048 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:28.915616 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:28.916066 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:28.916848 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:28.917267 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:28.919808 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:29.050954 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:29.058980 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-dc228b23-eb7c-4607-a493-caf981319c8c tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.155755 May 18 22:58:29.059558 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 620/1246] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:28 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 22:58:30.077403 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:30.078128 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:30.084930 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:30.085373 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:30.086174 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:30.086606 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:30.213117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:30.220433 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-720414b8-2469-41d1-b92e-1407b09e7630 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.147642 May 18 22:58:30.221000 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 627/1247] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:30 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:31.237091 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:31.237698 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:31.244002 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:31.244454 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:31.245214 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:31.245657 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:31.374366 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:31.381804 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7d894adf-add3-43cc-8d5e-02d87f293bf9 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.149074 May 18 22:58:31.382403 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 621/1248] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:31 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:32.398598 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:32.399207 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:32.405661 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:32.406134 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:32.406896 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:32.407329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:32.535496 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:32.543621 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d3ac6042-3d56-4fa7-b5b7-0312c7ed5faa tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.149041 May 18 22:58:32.544187 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 628/1249] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:32 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:33.559919 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:33.560463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:33.567013 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:33.568139 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:33.569027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:33.569468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:33.703797 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:33.711533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-81fbfb0d-c48a-4451-bf23-03aa3ed58f13 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.155511 May 18 22:58:33.712117 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 622/1250] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:33 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:33.791911 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-c772bbb1-9b2d-43a7-8082-5bcdd5481072 req-0500739e-af11-4e56-aab1-437e957c03bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8515e2b-c87b-4e41-9a68-05c6b7f13cf2", "name": "network-vif-plugged", "status": "completed", "tag": "17f2bcce-9850-48d0-b4a3-025f3cd6500e"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:33.800391 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c772bbb1-9b2d-43a7-8082-5bcdd5481072 req-0500739e-af11-4e56-aab1-437e957c03bd service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:33.800830 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-c772bbb1-9b2d-43a7-8082-5bcdd5481072 req-0500739e-af11-4e56-aab1-437e957c03bd service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:33.815225 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-c772bbb1-9b2d-43a7-8082-5bcdd5481072 req-0500739e-af11-4e56-aab1-437e957c03bd service nova] Creating event network-vif-plugged:17f2bcce-9850-48d0-b4a3-025f3cd6500e for instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 on hv-cinder-83800 May 18 22:58:33.817776 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-c772bbb1-9b2d-43a7-8082-5bcdd5481072 req-0500739e-af11-4e56-aab1-437e957c03bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029414 May 18 22:58:33.818398 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 629/1251] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:34.728886 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:34.729555 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:34.731499 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=2 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:34.732160 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell0:SELECT=6 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:34.737522 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:34.737973 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:34.738770 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:34.739952 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:34.871533 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:34.878889 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-4fe31712-5164-4f25-abfe-76bf3a243c8e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.153887 May 18 22:58:34.879467 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 623/1252] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:34 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:35.896346 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:35.897032 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:35.898972 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell0:SELECT=2 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:35.900048 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=41 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:35.904878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:35.905370 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:35.906100 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:35.906527 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:36.038736 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:36.046970 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-e6ccfe87-4264-4a3f-b98a-7b6c0249c96a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1314 microversion: 2.1 time: 0.154895 May 18 22:58:36.047652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 630/1253] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:35 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:37.064519 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:37.065141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:37.072047 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:37.072495 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:37.073264 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:37.073700 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:37.200780 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:37.208905 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7c4f9091-a85e-4f92-96b5-b8c17eddad59 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1498 microversion: 2.1 time: 0.148209 May 18 22:58:37.209468 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 624/1254] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:37 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:38.101828 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:38.102839 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:38.108922 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:38.109357 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:38.110140 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:38.110569 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:38.113045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=79 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:58:38.139585 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 22:58:38.431563 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-0e148f91-2a96-4edc-aded-a6fe2f570f7e tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 204 len: 0 microversion: 2.1 time: 0.333678 May 18 22:58:38.432493 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 631/1255] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 22:58:38 2022] DELETE /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 22:58:38.440423 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:38.441033 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:38.447825 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:38.448270 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:38.449027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:38.449463 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:38.581478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:38.588989 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-63c3db47-aa92-434a-9595-5a9f1f5dde44 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1504 microversion: 2.1 time: 0.152429 May 18 22:58:38.589580 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 625/1256] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:38 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:39.607490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:39.608256 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:39.614813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:39.615253 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:39.616248 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:39.616678 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:39.747490 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:39.755040 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-cb78e7e5-d29a-4519-9af5-a5b3d3eb9651 tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1504 microversion: 2.1 time: 0.151766 May 18 22:58:39.755618 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 632/1257] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:39 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:40.718402 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-72059137-00cf-4dde-8088-9799d2496768 req-cc1584c5-949b-4021-b4a5-a99be3cdf8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8515e2b-c87b-4e41-9a68-05c6b7f13cf2", "name": "network-vif-deleted", "tag": "17f2bcce-9850-48d0-b4a3-025f3cd6500e"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:58:40.728115 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-72059137-00cf-4dde-8088-9799d2496768 req-cc1584c5-949b-4021-b4a5-a99be3cdf8a6 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:40.728554 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-72059137-00cf-4dde-8088-9799d2496768 req-cc1584c5-949b-4021-b4a5-a99be3cdf8a6 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:40.739619 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-72059137-00cf-4dde-8088-9799d2496768 req-cc1584c5-949b-4021-b4a5-a99be3cdf8a6 service nova] Creating event network-vif-deleted:17f2bcce-9850-48d0-b4a3-025f3cd6500e for instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 on hv-cinder-83800 May 18 22:58:40.745311 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-72059137-00cf-4dde-8088-9799d2496768 req-cc1584c5-949b-4021-b4a5-a99be3cdf8a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030798 May 18 22:58:40.745899 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 626/1258] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 22:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 22:58:40.772873 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:40.773488 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:40.780141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:40.780594 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:40.781364 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:40.781808 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:40.844685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cbd496c75b84fffa96cbbf929fc5f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2b243ed5194c57a9513438ed308d2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:58:40.853191 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-6ef6f7d5-fa6e-4ad8-8efd-773e59a36d9a tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 200 len: 1462 microversion: 2.1 time: 0.084701 May 18 22:58:40.853936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 633/1259] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:40 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:58:41.871262 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:58:41.872901 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] [instance: f8515e2b-c87b-4e41-9a68-05c6b7f13cf2] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:58:41.879029 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:41.879474 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:41.880223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:58:41.880653 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:58:41.894176 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] HTTP exception thrown: Instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 could not be found. May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Request method failure captured: May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 HTTP/1.1 May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXn7uZPpGn6g_sHglss6sVd_J3OqmFmQqLNCBO0dODvcPld5FUZ75xHZTILT2zUT77myVIJU1XkASp2KVPOYToSvPCDPWSGQvUhxQZ07QA1mZCFTflzDz1YgyFHsweJvAfF2Jxffpww5BYp8fBVy84zaXxuBxx4rvxSq-JS9v4vmQO0 May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: 5b2b243ed5194c57a9513438ed308d2f May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-VolumesActionsTest-248597029 May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 22:58:41.897478 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5b2b243ed5194c57a9513438ed308d2f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2b243ed5194c57a9513438ed308d2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5b2b243ed5194c57a9513438ed308d2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5b2b243ed5194c57a9513438ed308d2f"}]}] May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-VolumesActionsTest-248597029 May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: 5b2b243ed5194c57a9513438ed308d2f May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-VolumesActionsTest-248597029 May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-VolumesActionsTest-248597029-project May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 1cbd496c75b84fffa96cbbf929fc5f5a May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-VolumesActionsTest-248597029-project May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 could not be found. May 18 22:58:41.899755 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'id': 'f8515e2b-c87b-4e41-9a68-05c6b7f13cf2'} May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 could not be found. May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 22:58:41.900820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 could not be found. May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 could not be found. May 18 22:58:41.902524 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 22:58:41.904203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] Returning 404 to user: Instance f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 could not be found. {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 22:58:41.904203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-51d65e2a-d0aa-46e9-b224-64c379e0f6ba tempest-VolumesActionsTest-248597029 tempest-VolumesActionsTest-248597029-project] 10.222.0.70 "GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2" status: 404 len: 111 microversion: 2.1 time: 0.031355 May 18 22:58:41.904203 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 627/1260] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:58:41 2022] GET /compute/v2.1/servers/f8515e2b-c87b-4e41-9a68-05c6b7f13cf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 22:59:02.445976 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 22:59:02.447004 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:02.449338 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:02.450045 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:02.454852 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:02.455295 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:02.456051 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:02.456518 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:02.624128 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7f866abe-64ec-462b-a1f1-615b32a778b1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/action" status: 202 len: 0 microversion: 2.1 time: 0.181683 May 18 22:59:02.628083 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 634/1261] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 22:59:02 2022] POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 22:59:02.636611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:02.638515 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:02.643443 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=15 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:02.644494 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=39 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 22:59:02.648981 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:02.649509 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:02.650708 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:02.651394 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:02.953514 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:02.962252 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d92b01bb-877d-484f-b690-5ce5d5296d58 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1751 microversion: 2.1 time: 0.331895 May 18 22:59:02.963688 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 628/1262] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:02 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1751 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:03.981855 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:03.982636 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:03.989439 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:03.989878 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:03.991815 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:03.992197 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:04.135707 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:04.143635 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-bbbbd544-e5f5-41d2-8657-a9f50c724163 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.166721 May 18 22:59:04.144201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 635/1263] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:03 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:05.161241 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:05.162364 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:05.169355 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:05.169798 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:05.170702 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:05.171081 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:05.316909 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:05.324839 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-49fa347c-55bb-4bc9-a9e3-1208b429cb2b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.167565 May 18 22:59:05.325398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 629/1264] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:05 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:06.341812 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:06.342455 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:06.348947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:06.350117 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:06.350861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:06.351300 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:06.499451 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:06.508228 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-66a5eec5-a780-42ff-97f4-aa87fcdf1da2 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.170378 May 18 22:59:06.508795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 636/1265] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:06 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:07.528520 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:07.529107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:07.535648 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:07.536088 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:07.537383 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:07.538377 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:07.684841 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:07.692794 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-33815f9c-d008-4a28-935b-686cdd645855 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.168176 May 18 22:59:07.693492 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 630/1266] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:07 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:08.713230 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:08.714090 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:08.720651 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:08.721085 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:08.721924 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:08.722426 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:08.887870 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:08.895995 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-d67ec2e3-b989-4285-8608-7062fe999e87 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.189716 May 18 22:59:08.896650 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 637/1267] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:08 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:09.913526 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:09.914266 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:09.921396 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:09.921850 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:09.922662 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:09.923103 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:10.066946 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:10.075906 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-85f9b26a-341c-42b3-a2b7-d6469e59006e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.166557 May 18 22:59:10.076462 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 631/1268] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:09 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:11.097078 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:11.097683 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:11.104927 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:11.105371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:11.106164 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:11.106598 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:11.255477 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:11.264018 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-f83dbf67-32c5-422d-a596-91e107f4da71 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.170938 May 18 22:59:11.264581 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 638/1269] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:11 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:12.281117 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:12.281750 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:12.288838 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:12.289525 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:12.290316 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:12.290747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:12.429417 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:12.437351 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-28b901ce-8e43-45c3-8032-9433dbba1e81 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.160331 May 18 22:59:12.437917 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 632/1270] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:12 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:13.453544 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:13.454183 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:13.461245 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:13.461699 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:13.462509 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:13.462947 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:13.608375 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:13.617184 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-43b12e12-148c-466d-8d88-fe308dae8802 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1756 microversion: 2.1 time: 0.167162 May 18 22:59:13.617750 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 639/1271] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:13 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:14.635611 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 22:59:14.636218 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 22:59:14.643235 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:14.643597 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:14.644345 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 22:59:14.644881 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 22:59:14.788710 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 22:59:14.797096 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-05bbb61e-4f8a-4a42-bcdc-32a93dd68c3a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1759 microversion: 2.1 time: 0.166180 May 18 22:59:14.797747 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 633/1272] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 22:59:14 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 22:59:50.579582 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 22:59:50.580204 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 22:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:00:18.021371 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_api:SELECT=12 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:18.022179 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG dbcounter [-] [124367] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:18.026236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1936310504"}} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 23:00:18.026761 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:18.033163 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:18.033605 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:18.034382 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:18.034814 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:18.163214 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.network.security_group_api [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Removing security group afc41bdb-26ff-4d5d-8cfb-ac29d91decf4 from port 05f877a6-d013-42a7-9c40-0e319d309c38 May 18 23:00:18.592685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-7000ae4e-ff2f-40d8-8e1b-29adc35f25ac tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/action" status: 202 len: 0 microversion: 2.1 time: 0.571707 May 18 23:00:18.592685 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 640/1273] 10.222.0.70 () {60 vars in 1277 bytes} [Wed May 18 23:00:18 2022] POST /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 23:00:18.610716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_api:SELECT=12 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:18.611530 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG dbcounter [-] [124366] Writing DB stats nova_cell1:SELECT=36 {{(pid=124366) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 23:00:18.615558 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [req-a9b7199d-4724-4f5d-a440-d6f9790adcda req-7ce51ed4-c023-45d7-a9eb-efba50818793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 23:00:18.629717 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a9b7199d-4724-4f5d-a440-d6f9790adcda req-7ce51ed4-c023-45d7-a9eb-efba50818793 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:18.630185 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [req-a9b7199d-4724-4f5d-a440-d6f9790adcda req-7ce51ed4-c023-45d7-a9eb-efba50818793 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:18.658627 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.compute.server_external_events [req-a9b7199d-4724-4f5d-a440-d6f9790adcda req-7ce51ed4-c023-45d7-a9eb-efba50818793 service nova] Creating event network-changed:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 23:00:18.665912 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [req-a9b7199d-4724-4f5d-a440-d6f9790adcda req-7ce51ed4-c023-45d7-a9eb-efba50818793 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056756 May 18 23:00:18.667374 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 634/1274] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 23:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 23:00:20.030290 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:20.030861 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:20.037571 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:20.038141 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:20.039246 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:20.039767 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:20.124167 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.objects.instance [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lazy-loading 'services' on Instance uuid 2d822aa2-f890-47bc-8771-77c3c4c0f15f {{(pid=124367) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 23:00:20.359989 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-766ddb9e-c7e9-422e-93e0-5c1ee7b8d60b tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments/555d3609-bc79-4167-a623-97916c3c02d9" status: 202 len: 0 microversion: 2.1 time: 0.334000 May 18 23:00:20.361222 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 641/1275] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 23:00:20 2022] DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments/555d3609-bc79-4167-a623-97916c3c02d9 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 23:00:20.371390 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:20.373027 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:20.380174 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:20.380618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:20.381475 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:20.381930 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:20.411118 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-d01daf8f-6d61-437e-909f-08f3dc90346a tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 May 18 23:00:20.411605 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 635/1276] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 23:00:20 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 23:00:20.683061 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-18491ab0-4278-4b43-a501-ec2a7e0d8882 req-f56865c0-1e91-4bc4-bbd9-ef0d2099d97d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 23:00:20.691841 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-18491ab0-4278-4b43-a501-ec2a7e0d8882 req-f56865c0-1e91-4bc4-bbd9-ef0d2099d97d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:20.692309 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-18491ab0-4278-4b43-a501-ec2a7e0d8882 req-f56865c0-1e91-4bc4-bbd9-ef0d2099d97d service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:20.703470 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-18491ab0-4278-4b43-a501-ec2a7e0d8882 req-f56865c0-1e91-4bc4-bbd9-ef0d2099d97d service nova] Creating event network-changed:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 23:00:20.709097 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-18491ab0-4278-4b43-a501-ec2a7e0d8882 req-f56865c0-1e91-4bc4-bbd9-ef0d2099d97d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030611 May 18 23:00:20.709737 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 642/1277] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 23:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 23:00:21.423292 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:21.424223 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:21.430416 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:21.431179 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:21.431635 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:21.432141 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:21.462745 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-1b433178-f490-4c3e-92e8-80dd0d1f112e tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043409 May 18 23:00:21.466772 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 636/1278] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 23:00:21 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 23:00:22.475758 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:22.476791 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:22.483355 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:22.483795 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:22.484540 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:22.484964 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:22.511886 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-c1ba190a-73c2-4872-8b7d-454264866723 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040408 May 18 23:00:22.512430 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 643/1279] 10.222.0.70 () {58 vars in 1301 bytes} [Wed May 18 23:00:22 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 23:00:22.522716 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:22.523205 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:22.530125 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:22.530567 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:22.531317 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:22.531753 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:22.604829 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.wsgi [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] HTTP exception thrown: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f is not attached to volume 555d3609-bc79-4167-a623-97916c3c02d9 May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Request method failure captured: May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: request: DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments/555d3609-bc79-4167-a623-97916c3c02d9 HTTP/1.1 May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept: application/json May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Accept-Encoding: identity May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Connection: close May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Length: 0 May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Content-Type: application/json May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Host: 10.222.0.70 May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Openstack-System-Scope: None May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: User-Agent: python-urllib3/1.26.9 May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Auth-Token: gAAAAABihXnDmPS2MVilaSQ0Du_9djDP9BsEJug9T3DZ8dUFk2FOTX1jUzdimYkD3HFJrWZIDKzPthv3Z8W62rVtRM5mNqxMKs3VYGDrG4ebkGe6wwvKcVGpdT8UoWc59TTLOJUV6Wf-DgrwhHKdWMSFPZgKuNlEtirlpWTIhXtUHSZoAzICVHg May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Id: None May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Domain-Name: None May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Identity-Status: Confirmed May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Is-Admin-Project: True May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Id: default May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Domain-Name: Default May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Id: d6448a906a594b6183ad55b7c49b24ff May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Project-Name: tempest-TestMinimumBasicScenario-1887342098 May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Role: reader,member May 18 23:00:22.616978 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Roles: reader,member May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d6448a906a594b6183ad55b7c49b24ff", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d6448a906a594b6183ad55b7c49b24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d6448a906a594b6183ad55b7c49b24ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d6448a906a594b6183ad55b7c49b24ff"}]}] May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant: tempest-TestMinimumBasicScenario-1887342098 May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Id: d6448a906a594b6183ad55b7c49b24ff May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1887342098 May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User: tempest-TestMinimumBasicScenario-1887342098-project May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Id: default May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Domain-Name: Default May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Id: 9360bc198e484dd0bdcd9239f4510b0a May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: X-User-Name: tempest-TestMinimumBasicScenario-1887342098-project May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: method: > May 18 23:00:22.618898 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: exception: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f is not attached to volume 555d3609-bc79-4167-a623-97916c3c02d9 May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: action_args: {'server_id': '2d822aa2-f890-47bc-8771-77c3c4c0f15f', 'id': '555d3609-bc79-4167-a623-97916c3c02d9'} May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 555d3609-bc79-4167-a623-97916c3c02d9. May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 23:00:22.619787 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f is not attached to volume 555d3609-bc79-4167-a623-97916c3c02d9 May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f is not attached to volume 555d3609-bc79-4167-a623-97916c3c02d9 May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: ERROR nova.api.openstack.wsgi May 18 23:00:22.621340 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Returning 404 to user: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f is not attached to volume 555d3609-bc79-4167-a623-97916c3c02d9 {{(pid=124366) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 23:00:22.622486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-472106f4-65f0-44d3-a10b-232ac6e2d262 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments/555d3609-bc79-4167-a623-97916c3c02d9" status: 404 len: 154 microversion: 2.1 time: 0.099625 May 18 23:00:22.622486 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 637/1280] 10.222.0.70 () {58 vars in 1415 bytes} [Wed May 18 23:00:22 2022] DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f/os-volume_attachments/555d3609-bc79-4167-a623-97916c3c02d9 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 23:00:23.917087 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:23.917567 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:23.924419 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:23.928123 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:23.928123 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:23.928123 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:23.949495 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Going to try to terminate instance {{(pid=124367) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 23:00:24.143985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-1cb89eeb-7edb-4623-9eba-4402a23960f1 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 204 len: 0 microversion: 2.1 time: 0.230710 May 18 23:00:24.144590 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 644/1281] 10.222.0.70 () {58 vars in 1238 bytes} [Wed May 18 23:00:23 2022] DELETE /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 23:00:24.152812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:24.154903 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:24.160832 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:24.161275 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:24.162055 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:24.162491 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:24.295193 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 23:00:24.303210 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-166b5ac9-c700-4c34-987c-ff58076347ff tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1554 microversion: 2.1 time: 0.154399 May 18 23:00:24.303778 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 638/1282] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 23:00:24 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 23:00:25.321005 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:25.321652 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:25.328201 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:25.328647 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:25.329601 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:25.330063 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:25.456862 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.policy [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124367) authorize /opt/stack/nova/nova/policy.py:199}} May 18 23:00:25.464236 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-9536b295-0ec6-45fa-afb3-a86d0e17def5 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1554 microversion: 2.1 time: 0.147566 May 18 23:00:25.464796 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 645/1283] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 23:00:25 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 23:00:26.482398 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:26.483078 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:26.491188 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:26.491990 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:26.492986 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:26.493636 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:26.721329 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 23:00:26.729126 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-7b2dbf3a-e204-4efb-a551-ebfd65e124f7 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1554 microversion: 2.1 time: 0.250546 May 18 23:00:26.732812 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 639/1284] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 23:00:26 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 23:00:26.998813 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [req-e2072c51-105f-407b-811c-5cc1cd1e4a8d req-6f5506b1-21ea-45d6-b2ac-c177560307e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d822aa2-f890-47bc-8771-77c3c4c0f15f", "name": "network-vif-deleted", "tag": "05f877a6-d013-42a7-9c40-0e319d309c38"}]} {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 23:00:27.008105 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-e2072c51-105f-407b-811c-5cc1cd1e4a8d req-6f5506b1-21ea-45d6-b2ac-c177560307e4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:27.008546 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [req-e2072c51-105f-407b-811c-5cc1cd1e4a8d req-6f5506b1-21ea-45d6-b2ac-c177560307e4 service nova] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:27.019412 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.compute.server_external_events [req-e2072c51-105f-407b-811c-5cc1cd1e4a8d req-6f5506b1-21ea-45d6-b2ac-c177560307e4 service nova] Creating event network-vif-deleted:05f877a6-d013-42a7-9c40-0e319d309c38 for instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f on hv-cinder-83800 May 18 23:00:27.024181 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [req-e2072c51-105f-407b-811c-5cc1cd1e4a8d req-6f5506b1-21ea-45d6-b2ac-c177560307e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028932 May 18 23:00:27.024761 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 646/1285] 10.222.0.70 () {64 vars in 1317 bytes} [Wed May 18 23:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 23:00:27.747365 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:27.748004 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.compute.api [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124366) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:27.754779 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:27.755224 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:27.755977 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:27.756410 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:27.787282 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:27.787722 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG oslo_concurrency.lockutils [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124366) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:27.788165 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.objects.instance [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lazy-loading 'fault' on Instance uuid 2d822aa2-f890-47bc-8771-77c3c4c0f15f {{(pid=124366) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 23:00:27.833096 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.policy [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9360bc198e484dd0bdcd9239f4510b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6448a906a594b6183ad55b7c49b24ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124366) authorize /opt/stack/nova/nova/policy.py:199}} May 18 23:00:27.840820 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-ff9a1255-061e-4637-a75e-27e7220a1d00 tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 200 len: 1348 microversion: 2.1 time: 0.097238 May 18 23:00:27.841565 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 640/1286] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 23:00:27 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 23:00:28.859936 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '>' {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:28.861341 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.compute.api [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] [instance: 2d822aa2-f890-47bc-8771-77c3c4c0f15f] Fetching instance by UUID {{(pid=124367) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 23:00:28.867344 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:28.867784 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:28.868534 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 23:00:28.868960 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG oslo_concurrency.lockutils [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Lock "0a5ec003-2fee-4752-99af-302cbb09e086" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124367) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 23:00:28.882081 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.wsgi [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] HTTP exception thrown: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f could not be found. May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Request method failure captured: May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: request: GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f HTTP/1.1 May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept: application/json May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Accept-Encoding: identity May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Connection: close May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Length: 0 May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Content-Type: application/json May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Host: 10.222.0.70 May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Openstack-System-Scope: None May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: User-Agent: python-urllib3/1.26.9 May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Auth-Token: gAAAAABihXnDmPS2MVilaSQ0Du_9djDP9BsEJug9T3DZ8dUFk2FOTX1jUzdimYkD3HFJrWZIDKzPthv3Z8W62rVtRM5mNqxMKs3VYGDrG4ebkGe6wwvKcVGpdT8UoWc59TTLOJUV6Wf-DgrwhHKdWMSFPZgKuNlEtirlpWTIhXtUHSZoAzICVHg May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Id: None May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Domain-Name: None May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Identity-Status: Confirmed May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Is-Admin-Project: True May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Id: default May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Domain-Name: Default May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Id: d6448a906a594b6183ad55b7c49b24ff May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Project-Name: tempest-TestMinimumBasicScenario-1887342098 May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Role: reader,member May 18 23:00:28.883660 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Roles: reader,member May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d6448a906a594b6183ad55b7c49b24ff", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d6448a906a594b6183ad55b7c49b24ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d6448a906a594b6183ad55b7c49b24ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d6448a906a594b6183ad55b7c49b24ff"}]}] May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant: tempest-TestMinimumBasicScenario-1887342098 May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Id: d6448a906a594b6183ad55b7c49b24ff May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1887342098 May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User: tempest-TestMinimumBasicScenario-1887342098-project May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Id: default May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Domain-Name: Default May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Id: 9360bc198e484dd0bdcd9239f4510b0a May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: X-User-Name: tempest-TestMinimumBasicScenario-1887342098-project May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: method: > May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: exception: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f could not be found. May 18 23:00:28.885466 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: action_args: {'id': '2d822aa2-f890-47bc-8771-77c3c4c0f15f'} May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: {{(pid=124367) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f could not be found. May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 23:00:28.886637 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f could not be found. May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f could not be found. May 18 23:00:28.888385 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: ERROR nova.api.openstack.wsgi May 18 23:00:28.889983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: DEBUG nova.api.openstack.wsgi [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Returning 404 to user: Instance 2d822aa2-f890-47bc-8771-77c3c4c0f15f could not be found. {{(pid=124367) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 23:00:28.889983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO nova.api.openstack.requestlog [None req-5d8091e8-7b75-47c1-ab44-615aa06e00ed tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f" status: 404 len: 111 microversion: 2.1 time: 0.029868 May 18 23:00:28.889983 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: [pid: 124367|app: 0|req: 647/1287] 10.222.0.70 () {58 vars in 1235 bytes} [Wed May 18 23:00:28 2022] GET /compute/v2.1/servers/2d822aa2-f890-47bc-8771-77c3c4c0f15f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 23:00:28.894024 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: DEBUG nova.api.openstack.wsgi [None req-5b51865f-80a8-44d0-8e26-5c7d649ce97c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] Calling method '.version_select at 0x7f6cd8fed820>' {{(pid=124366) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 23:00:28.944107 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:00:28.944344 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Wed May 18 23:00:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1050671995 (ip 10.222.0.70) !!! May 18 23:00:29.001376 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO nova.api.openstack.requestlog [None req-5b51865f-80a8-44d0-8e26-5c7d649ce97c tempest-TestMinimumBasicScenario-1887342098 tempest-TestMinimumBasicScenario-1887342098-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1050671995" status: 202 len: 0 microversion: 2.1 time: 0.111276 May 18 23:00:29.001956 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: [pid: 124366|app: 0|req: 641/1288] 10.222.0.70 () {58 vars in 1271 bytes} [Wed May 18 23:00:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1050671995 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 23:00:30.522136 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:00:30.522728 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 23:00:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:03:10.587474 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:03:10.588178 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 23:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:03:16.069164 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:03:16.069609 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Wed May 18 23:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:03:40.857329 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:03:40.857985 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 23:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:03:48.952127 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:03:48.952618 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Wed May 18 23:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:03:50.531535 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:03:50.532138 dv-cinder-838009-6-iscsi devstack@n-api.service[124367]: Wed May 18 23:03:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 23:05:20.444584 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 23:05:20.445151 dv-cinder-838009-6-iscsi devstack@n-api.service[124366]: Wed May 18 23:05:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!